Azure Data Engineer

1 week ago

Sydney, New South Wales, Australia Robert Half Full time $90,000 - $120,000 per year
Job Description:Key Responsibilities:
  • Design, develop, and monitor data ingestion pipelines from various sources.
  • Continuously improve and optimize existing data pipelines for performance and scalability.
  • Model data from API outputs into a relational format.
  • Develop CI/CD pipelines using GitHub Actions.
  • Provide support to ensure secure access to data for necessary teams and meet data quality and governance requirements.
Essential skills:
  • Proven background with data engineering and development
  • Experience with Azure Data Factory, Azure Databricks and/or Synapse Analytics, Azure Event Hubs
  • Knowledge of Medallion Architecture/ Lakehouse/Data Warehouse in Fabric
  • Experience in building data ingestion pipelines in Fabric
  • Experience in Infrastructure-As-Code tools such as Terraform
  • Experience in data architecture, data modelling, Data warehousing and SDLC
  • Advanced SQL experience
  • Experience with cloud storage concepts (e.g., Azure Blob Storage)
  • Use Microsoft DevOps (CI/CD) to deploy new pipelines or implement changes to existing ones.
  • Expertise in SQL and Python scripting
  • Experienced with Docker/containerization
  • Experience with visualisation tools such as Power BI
  • Excellent communication skills with the ability to work effectively with a range of stakeholders
  • Have a deep understanding of IaaS and PaaS services offered on the various cloud platforms and understand how to use them together to build complex solutions.
  • Ability to work independently and effectively within a team environment.
  • Any experience working in the Insurance domain will be highly desirable.
Requirements:

Robert Half

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia AI Hustler Full time $104,000 - $130,878 per year

    We are urgently seeking a highly skilled and experiencedAzure Databricks Data Engineerto join our team in Sydney. This is a critical role for our data engineering function, focused on building robust, scalable, and efficient data solutions within the Azure cloud environment.If you have a passion for building complex data pipelines and thrive on solving...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    5 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Ashdown People Full time $150,000 - $200,000 per year

    Are you ready to take on a role where your work directly shapes how large-scale platforms operate, process massive datasets, and deliver actionable insights? We are seeking an experienced Senior Data Engineer to join a high-performing team working with some of the most advanced distributed systems in the industry. In this role, you'll be building and...

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Robert Half Full time $90,000 - $120,000 per year

    This insurance firm is actively seeking a highly skilled Data Engineer to join their Data and Analytics team. The ideal candidate is adept at creating and optimizing data systems and has a strong background in data pipeline development and data wrangling. If you thrive in a collaborative environment and have a passion for data, this is the perfect...

  • Senior Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia INGRITY Full time $120,000 - $140,000 per year

    Are you a well-rounded Senior Azure Data Engineer with a passion for architecting scalable, efficient, and secure data solutions? Join our esteemed team at INGRITY, where your skills will play a crucial role in serving our clients effectively. Location: Sydney. Employment Type: Full-Time. Eligibility: Open to candidates with full working...

  • Microsoft Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Buscojobs Full time

    We are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining data architecture, models, and standards for Data Integration & Data Warehouse projects in Azure.Ensure new features and subject areas are integrated with existing structures to provide a consistent view.Develop and maintain documentation of data architecture, data...

  • Microsoft Azure Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Buscojobs Full time

    We are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining data architecture, models, and standards for Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are integrated with existing structures to provide a consistent view. Develop and maintain documentation of data architecture,...