Senior Azure Data Engineer

4 weeks ago

Sydney, New South Wales, Australia M&T Resources Full time

Job Title: Senior Azure Data Engineer

Job Summary: We are seeking a highly skilled Senior Azure Data Engineer to lead the migration of our clients' legacy on-premises data warehouse to a cutting-edge data platform on Azure.

Key Responsibilities:

  • Lead the migration from on-premises data warehouses to Azure-based data platforms.
  • Design and build fully automated end-to-end data pipelines in Azure using PySpark and other cloud-native technologies.
  • Collaborate with stakeholders to integrate BI reports, UDAs, downstream systems, and third-party data feeds.
  • Optimize SQL for performance in a cloud data warehouse environment and ensure smooth data flows between systems.
  • Work with both structured and unstructured data types (JSON, XML, AVRO) and handle high-volume batch and near real-time data processing.
  • Contribute to the creation of data products, data mesh architectures, and modern cloud data solutions.

Requirements:

  • 7+ years of experience in Data Warehousing and Data Engineering within the banking sector.
  • At least 2 years of hands-on experience designing and delivering data engineering solutions with PySpark in Azure.
  • Proven experience in large data migrations and setting up data platforms in the cloud (Azure).
  • Expertise in building automated, scalable data pipelines and advanced SQL for data warehouses, Big Data, and Data Bricks.
  • Proficiency with Big Data tools like Spark (Python/Scala) and experience in cloud data warehouses (Azure Synapse, Data Lake, etc.).
  • Hands-on experience with CI/CD processes using tools such as Bitbucket/GitHub, Jenkins, and Nexus.
  • Experience working with modern architectures, including microservices, REST APIs, and data-as-a-service frameworks.
  • Knowledge of decentralized data architecture – Data Mesh.

  • Senior Data Migration Engineer

    4 weeks ago

    Sydney, New South Wales, Australia M&T Resources Full time

    Job Title: Senior Data Migration Engineer - AzureAbout the Role:We are seeking a highly experienced Senior Data Migration Engineer to lead the migration of our clients' legacy on-premises data warehouse to a cutting-edge data platform on Azure. This is a unique opportunity to work on large data engineering projects within the banking sector, delivering...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia BaptistCare Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at BaptistCare. As a Senior Data Engineer, you will be responsible for designing, implementing, and optimizing data pipelines on Azure Data Platform for reporting.You will work closely with our Data and Analytics team to deliver and implement detailed designs across various...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to design, implement, and support telemetry systems and reporting solutions within our IT environments. The...

  • Azure Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia One51 Consulting Full time

    We are seeking a highly skilled Azure Data Engineer to join our team at One51 Consulting. In this role, you will be responsible for designing, developing, and maintaining data architectures, data models, and standards for various Data Integration and Data Warehouse projects in Azure. Your expertise should include ETL pipelines, data warehousing, and big data...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About Us:CDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Headquartered in Canberra, our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute environments with all campuses interconnected with high-speed carrier grade...

  • Azure Databricks Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    About the RoleXPT Software Australia Pty Ltd is seeking a highly skilled Azure Databricks Data Engineer to join our team.Key ResponsibilitiesDesign, develop, and maintain large-scale data processing pipelines using Azure Databricks.Collaborate with cross-functional teams to integrate data engineering solutions with business requirements.Develop and maintain...

  • Azure Databricks Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    Job DescriptionDetailed JD *(Roles and Responsibilities)We are seeking a highly skilled Azure Databricks Data Engineer to join our team at XPT Software Australia Pty Ltd.Key Responsibilities• Design, develop, and maintain large-scale data processing pipelines using Azure Databricks and Azure Data Lake.• Collaborate with cross-functional teams to identify...

  • Data Engineer with Azure Focus

    3 weeks ago

    Sydney, New South Wales, Australia Talent Insights Full time

    About the RoleTalent Insights is seeking a highly skilled Senior Analytics Engineer to join our team. As a Senior Analytics Engineer, you will play a key role in developing and implementing greenfield data solutions that empower our clients to make informed, data-driven decisions.ResponsibilitiesDesign, build, and maintain data warehouses and ETL processes...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our company was established in 2007 and has since grown to become a major player in the industry.We are headquartered in Canberra and have multiple facilities in the ACT, NSW, and New Zealand. Our diversified operations provide secure data...

  • Azure Databricks Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    Job RequirementsWe are seeking a skilled Azure Databricks Data Engineer to join our team at XPT Software Australia Pty Ltd.Key Responsibilities Develop and maintain large-scale data processing workflows using Azure Databricks and Pypark. Collaborate with cross-functional teams to design and implement data-driven solutions. Ensure data quality, integrity, and...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to design, implement, and support telemetry systems and reporting solutions within our IT environments.The...

  • Senior Data Engineer for Cloud Solutions

    5 days ago

    Sydney, New South Wales, Australia Senior Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team in designing and building cloud-based data solutions. As a key member of our engineering team, you will be responsible for delivering innovative data pipelines, data warehouses, and machine learning solutions on Google Cloud Platform.About the RoleThe ideal candidate is a...

  • Senior Data Engineering Leader for Large-Scale Azure Project

    3 days ago

    Sydney, New South Wales, Australia The Recruitment Company Full time

    About The Role:The Recruitment Company is seeking an experienced Senior Data Engineer to join a high-profile project in Australia.As a Senior Data Engineer, you will be responsible for collaborating with a wider team to establish a modern lakehouse data platform using Microsoft Fabric, ingesting validating and reporting on high-value client data.This is an...

  • Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    About the RoleXPT Software Australia Pty Ltd is seeking a highly skilled Data Engineer to join our team. As an Azure Databricks Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Azure Databricks and related technologies.Key ResponsibilitiesDesign and implement data pipelines using Azure...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About Cdc Data Centres:We are a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute environments with all campuses interconnected with high-speed carrier grade networks.We are passionate about...

  • Senior Data Engineer

    1 month ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Established in 2007, we have a strong presence in Canberra, NSW, and New Zealand, with a diverse range of operations that provide secure data centre configurations for co-location, containerised, and hyperscale compute environments.We are...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About CDC Data CentresWe are a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team by creating an inclusive workplace that promotes and values diversity.About the RoleWe are seeking a highly skilled Senior Data Engineer to design,...

  • Data Engineer

    1 month ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    Job DescriptionDetailed JD *(Roles and Responsibilities)We are seeking a highly skilled Data Engineer with expertise in Azure Databricks to join our team at XPT Software Australia Pty Ltd. The ideal candidate will have a good understanding of Azure services, particularly Azure Databricks and Azure Data Lake, and be familiar with programming languages such as...

  • Cloud Data Engineer with Expertise in Azure Solutions

    5 days ago

    Sydney, New South Wales, Australia INGRITY Full time

    We are seeking an experienced Cloud Data Engineer to join our team at INGRITY, a progressive data and analytics company based in Sydney. The successful candidate will have extensive expertise in data engineering and a strong focus on Azure technologies.About the JobAs a Cloud Data Engineer, you will be responsible for designing end-to-end data solutions on...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Nexon Asia Pacific Full time

    About the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Nexon Asia Pacific. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing comprehensive analytics and data platforms using Azure and Microsoft Fabric.Key Responsibilities:Lead the implementation of an end-to-end...