Azure Data Engineer

1 week ago

Sydney, New South Wales, Australia Robert Half Full time $90,000 - $120,000 per year

This insurance firm is actively seeking a highly skilled Data Engineer to join their Data and Analytics team. The ideal candidate is adept at creating and optimizing data systems and has a strong background in data pipeline development and data wrangling.

If you thrive in a collaborative environment and have a passion for data, this is the perfect opportunity for you

Key Responsibilities:

  • Design, develop, and monitor data ingestion pipelines from various sources.
  • Continuously improve and optimize existing data pipelines for performance and scalability.
  • Model data from API outputs into a relational format.
  • Develop CI/CD pipelines using GitHub Actions.
  • Provide support to ensure secure access to data for necessary teams and meet data quality and governance requirements.

Essential skills:

  • Proven background with data engineering and development
  • Experience with Azure Data Factory, Azure Databricks and/or Synapse Analytics, Azure Event Hubs
  • Knowledge of Medallion Architecture/ Lakehouse/Data Warehouse in Fabric
  • Experience in building data ingestion pipelines in Fabric
  • Experience in Infrastructure-As-Code tools such as Terraform
  • Experience in data architecture, data modelling, Data warehousing and SDLC
  • Advanced SQL experience
  • Experience with cloud storage concepts (e.g., Azure Blob Storage)
  • Use Microsoft DevOps (CI/CD) to deploy new pipelines or implement changes to existing ones.
  • Expertise in SQL and Python scripting
  • Experienced with Docker/containerization
  • Experience with visualisation tools such as Power BI
  • Excellent communication skills with the ability to work effectively with a range of stakeholders
  • Have a deep understanding of IaaS and PaaS services offered on the various cloud platforms and understand how to use them together to build complex solutions.
  • Ability to work independently and effectively within a team environment.
  • Any experience working in the Insurance domain will be highly desirable.

The client offers a 2 day in office / 3 day from home hybrid working model.

By clicking 'apply', you give your express consent that Robert Half may use your personal information to process your job application and to contact you from time to time for future employment opportunities. For further information on how Robert Half processes your personal information and how to access and correct your information, please read the Robert Half privacy notice: Please do not submit any sensitive personal data to us in your resume (such as government ID numbers, ethnicity, gender, religion, marital status or trade union membership) as we do not collect your sensitive personal data at this time.

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia AI Hustler Full time $104,000 - $130,878 per year

    We are urgently seeking a highly skilled and experiencedAzure Databricks Data Engineerto join our team in Sydney. This is a critical role for our data engineering function, focused on building robust, scalable, and efficient data solutions within the Azure cloud environment.If you have a passion for building complex data pipelines and thrive on solving...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Ashdown People Full time $150,000 - $200,000 per year

    Are you ready to take on a role where your work directly shapes how large-scale platforms operate, process massive datasets, and deliver actionable insights? We are seeking an experienced Senior Data Engineer to join a high-performing team working with some of the most advanced distributed systems in the industry. In this role, you'll be building and...

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Robert Half Full time $90,000 - $120,000 per year

    Job Description:Key Responsibilities: Design, develop, and monitor data ingestion pipelines from various sources. Continuously improve and optimize existing data pipelines for performance and scalability. Model data from API outputs into a relational format. Develop CI/CD pipelines using GitHub Actions. Provide support to ensure secure access to data for...

  • Senior Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia INGRITY Full time $120,000 - $140,000 per year

    Are you a well-rounded Senior Azure Data Engineer with a passion for architecting scalable, efficient, and secure data solutions? Join our esteemed team at INGRITY, where your skills will play a crucial role in serving our clients effectively. Location: Sydney. Employment Type: Full-Time. Eligibility: Open to candidates with full working...

  • Microsoft Azure Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Buscojobs Full time

    We are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining data architecture, models, and standards for Data Integration & Data Warehouse projects in Azure.Ensure new features and subject areas are integrated with existing structures to provide a consistent view.Develop and maintain documentation of data architecture, data...

  • Microsoft Azure Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Buscojobs Full time

    We are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining data architecture, models, and standards for Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are integrated with existing structures to provide a consistent view. Develop and maintain documentation of data architecture,...