Azure Databricks Consultant

1 week ago


Melbourne, Victoria, Australia Nuage Technology Group Full time

Consultants (Information & Communication Technology) Full time Add expected salary to your profile for insights Nuage has partnered with a Global Consultancy for an exciting opportunity.

As an Azure Databricks Consultant, you will play a critical role in designing, implementing, and optimising our data infrastructure and analytics solutions.

You will work closely with cross-functional teams to understand their data needs and deliver scalable, efficient data pipelines using Azure Databricks.

Your expertise will help drive data-driven decision-making and enhance machine learning capabilities.

Responsibilities:

Design, develop, and optimise data pipelines and ETL processes using Azure Databricks to transform raw data into actionable insights.

Implement and manage large-scale data processing systems leveraging Apache Spark, ensuring efficient data transformation and analysis.

Work closely with Data Scientists and Analysts to integrate machine learning models into data pipelines, enhancing our predictive analytics capabilities.

Continuously monitor and optimise the performance and scalability of data processing jobs to meet business requirements.

Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics to create a seamless data ecosystem.


Skills:
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Proven experience as an Azure Databricks Consultant or in a similar role.
Strong proficiency in Apache Spark, Python, and/or Scala.
Hands-on experience with Azure Databricks, including workspace management, cluster management, and job orchestration.

Solid understanding of Azure cloud services, including Azure Data Lake Storage, Azure SQL Database, Azure Synapse Analytics, and Azure Blob Storage.

Experience with data warehousing, ETL processes, and data integration.
Familiarity with machine learning concepts and integrating ML models into data pipelines.
Excellent problem-solving and analytical skills.
Strong communication and collaboration abilities.
Azure certifications such as

Microsoft Certified:
Azure Data Engineer Associate or similar are a plus.

MUST have full working rights for Australia (Minimum of Australian Permanent Residency, or Australian Citizenship)If you have depth in Azure Databricks and are passionate about shaping the future of data engineering and enjoy tackling complex challenges, please apply for this exciting opportunity.

Join the client in building innovative and scalable data solutions that drive the client's success.
For more information on the Australian Technology market, please feel free to follow us on

Linked In:
As Member=true or visit our website Report this job advert Don't provide your bank or credit card details when applying for jobs.
Choose from thousands of courses delivered by leaders in education.

#J-18808-Ljbffr

  • Melbourne, Victoria, Australia Nuage Technology Group Full time

    Consultants (Information & Communication Technology)Full timeAdd expected salary to your profile for insightsNuage has partnered with a Global Consultancy for an exciting opportunity. As an Azure Databricks Consultant, you will play a critical role in designing, implementing, and optimising our data infrastructure and analytics solutions. You will work...


  • Melbourne, Victoria, Australia Aurec Human Capital Group Full time

    Our client is a seeking an experienced Azure Synapse Consultant to join a global IT Consulting services organisation recognized for their extensive portfolio of services & commitment to sustainability.The role:In this role, you will utilize your deep knowledge of the Azure Synapse platform to design and implement solutions that deliver business value. You...

  • Azure Data Engineer

    1 week ago


    Melbourne, Victoria, Australia Experis Full time

    Experis have the pleasure to announce a partnership with a global consultancy in their search for an experienced Data Engineer. This consultancy focuses on accelerating their customers migration to cloud and aims to digitalize and automate their operations. You will have the opportunity to work within a dynamic team focused on developing large-scale data...


  • Melbourne, Victoria, Australia Arinco trades as Arinco (VIC) Pty Full time

    Work options: HybridFounded in March 2019 and headquartered in Melbourne, we are a leading technology consulting business specialising in digital transformation for mid-size, government and enterprise businesses. Our origins are in AI and we proudly deliver marketing-leading AI solutions to customers in partnership with Microsoft, as one of their top AI...

  • Azure Data Factory

    1 week ago


    Melbourne, Victoria, Australia PanAsia HR Resourcing Full time

    **Must Have Azure DataBricks,Azure Data Factory, PySpark, ADLS, (Event Hub or Kinesis or Kafka)* Azure Technology stack Azure Data Factory, (good Working Experience) Azure Databricks- (good Working Experience) ADLS2, Strong Skills in PySpark (good Working Experience) Strong Data Streaming experience in Event Hub or Kinesis or Kafka. (Hands on) Strong skills...


  • Melbourne, Victoria, Australia Databricks Full time

    As we continue to increase our presence in the Unified Data Analytics and AI world, we're looking for a creative, motivated and execution oriented Enterprise Account Executive within Australia to maximise the huge market opportunity that exists for Databricks today.Reporting to the Enterprise Sales Director, as an Enterprise Account Executive, you will be...

  • Azure Data Engineer

    1 week ago


    Melbourne, Victoria, Australia Capgemini Full time

    About Capgemini: Capgemini is a diverse collective of more than 350,000 strategic and technological experts based across more than 50 countries, partnering with world-renowned clients to transform and manage their businesses. We are dedicated to leveraging cloud, data, AI, connectivity, software, digital engineering, and platforms to address the entire...

  • Azure Data Factory

    1 week ago


    Melbourne, Victoria, Australia Panasia Group Full time

    Experience 5+ Years/8+ years**Must Have Azure DataBricks, Azure Data Factory, PySpark, ADLS, (Event Hub or Kinesis or Kafka)* Azure Technology stack Azure Data Factory, (good Working Experience) Azure Databricks- (good Working Experience) ADLS2, Strong Skills in PySpark (good Working Experience) Strong Data Streaming experience in Event Hub or Kinesis or...

  • Pyspark Consultant

    1 week ago


    Melbourne, Victoria, Australia luvo Full time

    Melbourne based Permanent OR Contract position. Hybrid working max 3 days from office. Great organization to work with. Extract Transform and Load data from sources Systems to Azure Data Storage services using a combination of Azure Data factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data...


  • Melbourne, Victoria, Australia Databricks Inc. Full time

    While candidates in the listed location are encouraged for this role, we are open to remote candidates in Brisbane.At Databricks we are on a mission to empower our customers to solve the world's toughest data problems by utilising the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you will play an important role during this...


  • Melbourne, Victoria, Australia 5th Wave Recruiting Full time

    Microsoft FabricDatabricksConsultantThe CompanyOur customer is one of Australia's largest specialist consulting firms focused on designing and implementing IT solutions in Financial Performance Management, BI, Financial Reporting, Data Visualisation, Predictive Analytics and Information Management for both public and private sector organisations throughout...


  • Melbourne, Victoria, Australia Experis Full time

    Immediate start for the right personHybrid working arrangementMelbourne VictoriaWe are seeking a highly skilled and experienced Azure Data Analytics Engineer to join our dynamic team. As an Azure Data Analytics Engineer, you will play a crucial role in developing and maintaining our data analytics infrastructure using core Azure technologies. If you have a...


  • Melbourne, Victoria, Australia One51 | Data & Analytics Consultancy Full time

    We are looking for a Microsoft Azure Data Engineer who will be responsible for developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. In addition, develop...


  • Melbourne, Victoria, Australia Arinco trades as Arinco (VIC) Pty Full time

    Work options:HybridFounded in March 2019 and headquartered in Melbourne, we are a leading technology consulting business specialising in digital transformation for mid-size, government and enterprise businesses. Our origins are in AI and we proudly deliver marketing-leading AI solutions to customers in partnership with Microsoft, as one of their top AI...


  • Melbourne, Victoria, Australia Arinco Trades As Arinco Full time

    Work options: Hybrid Founded in March 2019 and headquartered in Melbourne, we are a leading technology consulting business specialising in digital transformation for mid-size, government and enterprise businesses.Our origins are in AI and we proudly deliver marketing-leading AI solutions to customers in partnership with Microsoft, as one of their top AI...


  • Melbourne, Victoria, Australia Arinco Trades As Arinco Full time

    Work options: Hybrid Founded in March 2019 and headquartered in Melbourne, we are a leading technology consulting business specialising in digital transformation for mid-size, government and enterprise businesses.Our origins are in AI and we proudly deliver marketing-leading AI solutions to customers in partnership with Microsoft, as one of their top AI...

  • Data Practice lead

    1 week ago


    Melbourne, Victoria, Australia ClearCompany Full time

    Software Development business looking for a Data Practice Lead based in MelbourneData Practice lead - Melbourne - $200k to $230k + super Azure DatabricksA global software development company is looking for someone to head up their Data Practice, based in Melbourne. This organization have a strong local presence in the market (circa 60 in Melbourne). They...


  • Melbourne, Victoria, Australia Logicalis Full time

    Azure Technical Consultant (Managed Services)Add expected salary to your profile for insightsWe are on the lookout for a seasoned Azure Cloud Technical Consultant to come join our Managed Services team in a post-sales consulting role. You will play a pivotal role in driving customer retention and cloud adoption across a portfolio of high value clients.You...

  • Data Consultant

    1 week ago


    Melbourne, Victoria, Australia Emanate Technology Full time

    The Opportunity We are working with a stand out Australian Data Consultancy to help them grow their team to support the ongoing success of their business. Our client works with leading data technology and has a strong pipeline of projects with ASX200 clients, they pride themselves on their exceptional service and delivery this continues to win them further...


  • Melbourne, Victoria, Australia Online Business Technologies Full time

    Azure Cloud Security Consultant (Melbourne)Join a global information technology pioneer in the Cloud Services arena represented in Australia, Singapore, Europe and the USA. OBT is both a Managed Cloud Service Provider to SMEs as well as a high-value Consultancy to Enterprises. Being a two-time winner of the Microsoft Hosting Partner of the Year Award, as...