Azure Data Engineer

3 weeks ago

Sydney, Australia M&T Resources Full time

Sydney

IT & Telecomms DBA / Database Developer

  • Big 4 banking experience highly beneficial
  • Azure / Data Migration/ Pyspark / Data Warehousing
  • Hybrid working environment / Day Rate contract

Are you an experienced Data Engineer with a passion for driving large scale data migrations? Do you have a strong background in building data platforms and automated pipelines in Azure? If so, we want to hear from you
  
We’re seeking a Senior Azure Data Engineer to lead the migration of our clients legacy on-premises data warehouse to a cutting-edge data platform on Azure. This is a unique opportunity to work on large data engineering project within the banking sector, delivering solutions that support reporting, analytics, and a variety of downstream systems and third-party data feeds.
  
Key Responsibilities:

  • Lead the migration from on prem data warehouses to Azure based data platforms.
  • Design and build fully automated end-to-end data pipelines in Azure using PySpark and other cloud-native technologies.
  • Collaborate with stakeholders to integrate BI reports, UDAs, downstream systems, and third-party data feeds.
  • Optimise SQL for performance in a cloud data warehouse environment and ensure smooth data flows between systems.
  • Work with both structured and unstructured data types (JSON, XML, AVRO) and handle high-volume batch and near real-time data processing.
  • Contribute to the creation of data products, data mesh architectures, and modern cloud data solutions

  
What We’re Looking For:

  • 7+ years of experience in Data Warehousing and Data Engineering within the banking sector.
  • At least 2 years of hands-on experience designing and delivering data engineering solutions with PySpark in Azure.
  • Proven experience in large data migrations and setting up data platforms in the cloud (Azure).
  • Expertise in building automated, scalable data pipelines and advanced SQL for data warehouses, Big Data, and Data Bricks.
  • Proficiency with Big Data tools like Spark (Python/Scala) and experience in cloud data warehouses (Azure Synapse, Data Lake, etc.).
  • Hands-on experience with CI/CD processes using tools such as Bitbucket/GitHub, Jenkins, and Nexus.
  • Experience working with modern architectures, including microservices, REST APIs, and data-as-a-service frameworks.
  • Knowledge of decentralised data architecture – Data Mesh

If you feel you meet most of the requirements, I would love to hear from you – if you have any questions, please email kiernan.mcneill@mtr.com.au

Apply Now

  • Senior Azure Data Engineer

    4 weeks ago

    North Sydney Council, Australia NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Azure Data Engineer to join our team at NTT DATA Business Solutions. As a key member of our Analytics Practice, you will be responsible for designing and developing cloud-based data solutions using Microsoft Azure technologies.Key ResponsibilitiesAnalyze current business practices and identify...

  • Senior Azure Data Engineer

    7 months ago

    North Sydney, Australia NTT DATA Full time

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia One51 Consulting Full time

    We are seeking a highly skilled Azure Data Engineer to join our team at One51 Consulting. In this role, you will be responsible for designing, developing, and maintaining data architectures, data models, and standards for various Data Integration and Data Warehouse projects in Azure. Your expertise should include ETL pipelines, data warehousing, and big data...

  • Senior Azure Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia M&T Resources Full time

    Job Title: Senior Azure Data EngineerJob Summary: We are seeking a highly skilled Senior Azure Data Engineer to lead the migration of our clients' legacy on-premises data warehouse to a cutting-edge data platform on Azure.Key Responsibilities:Lead the migration from on-premises data warehouses to Azure-based data platforms.Design and build fully automated...

  • Data Engineer

    2 months ago

    Sydney, Australia InfoCentric Full time

    At InfoCentric, we're dedicated to harnessing the power of cloud technology to drive innovation and excellence. We are looking for a skilled Azure Data Engineer for a full-time, permanent position based in Sydney, Australia. Minimum of 3 years of experience in Data EngineeringProven experience with Azure Synapse and Microsoft...

  • Senior Data Engineer – Azure

    4 weeks ago

    Sydney, New South Wales, Australia M&T Resources Full time

    SydneyIT & Telecomms DBA / Database DeveloperBig 4 banking experience highly beneficialAzure / Data Migration/ Pyspark / Data WarehousingHybrid working environment / Day Rate contractWe're seeking a Senior Data Engineer to lead the migration of our clients legacy on-premises data warehouse to a cutting-edge data platform on Azure. This is a unique...

  • Azure Databricks Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    About the RoleXPT Software Australia Pty Ltd is seeking a highly skilled Azure Databricks Data Engineer to join our team.Key ResponsibilitiesDesign, develop, and maintain large-scale data processing pipelines using Azure Databricks.Collaborate with cross-functional teams to integrate data engineering solutions with business requirements.Develop and maintain...

  • Azure Databricks Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    Job DescriptionDetailed JD *(Roles and Responsibilities)We are seeking a highly skilled Azure Databricks Data Engineer to join our team at XPT Software Australia Pty Ltd.Key Responsibilities• Design, develop, and maintain large-scale data processing pipelines using Azure Databricks and Azure Data Lake.• Collaborate with cross-functional teams to identify...

  • Azure Databricks Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    Job RequirementsWe are seeking a skilled Azure Databricks Data Engineer to join our team at XPT Software Australia Pty Ltd.Key Responsibilities Develop and maintain large-scale data processing workflows using Azure Databricks and Pypark. Collaborate with cross-functional teams to design and implement data-driven solutions. Ensure data quality, integrity, and...

  • Senior Data Migration Engineer

    4 weeks ago

    Sydney, New South Wales, Australia M&T Resources Full time

    Job Title: Senior Data Migration Engineer - AzureAbout the Role:We are seeking a highly experienced Senior Data Migration Engineer to lead the migration of our clients' legacy on-premises data warehouse to a cutting-edge data platform on Azure. This is a unique opportunity to work on large data engineering projects within the banking sector, delivering...

  • Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    About the RoleXPT Software Australia Pty Ltd is seeking a highly skilled Data Engineer to join our team. As an Azure Databricks Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Azure Databricks and related technologies.Key ResponsibilitiesDesign and implement data pipelines using Azure...

  • Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    Job DescriptionDetailed JD *(Roles and Responsibilities)We are seeking a highly skilled Data Engineer with expertise in Azure Databricks to join our team at XPT Software Australia Pty Ltd. The ideal candidate will have a good understanding of Azure services, particularly Azure Databricks and Azure Data Lake, and be familiar with programming languages such as...

  • Cloud Data Engineer with Expertise in Azure Solutions

    2 days ago

    Sydney, New South Wales, Australia INGRITY Full time

    We are seeking an experienced Cloud Data Engineer to join our team at INGRITY, a progressive data and analytics company based in Sydney. The successful candidate will have extensive expertise in data engineering and a strong focus on Azure technologies.About the JobAs a Cloud Data Engineer, you will be responsible for designing end-to-end data solutions on...

  • Data Engineering Leader for Azure Platform

    3 days ago

    Sydney, New South Wales, Australia Essential Energy Full time

    About the RoleWe are seeking an experienced Data Engineering Leader to join our Digital Delivery division. This role can be based anywhere within Essential Energy's operational footprint and will involve designing, developing, and maintaining data pipeline architecture, data models, data stores, and data infrastructure.Key ResponsibilitiesDirecting data...

  • Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    Job DescriptionXPT Software Australia Pty Ltd is seeking a highly skilled Azure Databricks Engineer to join our team.Key Responsibilities Develop and maintain large-scale data processing pipelines using Azure Databricks and Python. Collaborate with cross-functional teams to design and implement data-driven solutions. Ensure data quality, integrity, and...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia BaptistCare Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at BaptistCare. As a Senior Data Engineer, you will be responsible for designing, implementing, and optimizing data pipelines on Azure Data Platform for reporting.You will work closely with our Data and Analytics team to deliver and implement detailed designs across various...

  • Data Engineer with Azure Focus

    2 weeks ago

    Sydney, New South Wales, Australia Talent Insights Full time

    About the RoleTalent Insights is seeking a highly skilled Senior Analytics Engineer to join our team. As a Senior Analytics Engineer, you will play a key role in developing and implementing greenfield data solutions that empower our clients to make informed, data-driven decisions.ResponsibilitiesDesign, build, and maintain data warehouses and ETL processes...

  • Azure Cloud Data Architect

    2 weeks ago

    Sydney, New South Wales, Australia M&T Resources Full time

    Mission Critical Data MigrationWe are seeking an experienced Data Engineer to lead the migration of our clients' legacy on-premises data warehouse to a cutting-edge data platform on Azure. This is a unique opportunity to work on large data engineering projects, delivering solutions that support reporting, analytics, and a variety of downstream systems and...

  • Azure Solutions Architect Opportunity for Data Engineering Expert

    2 days ago

    Sydney, New South Wales, Australia INGRITY Full time

    We are a progressive data and analytics company based in Sydney, Australia, delivering actionable insights to drive impact. We've seen success in leading and delivering major data transformation programs in large and medium enterprises.About UsINGRITY is a fast-growing company that services many large corporates and SMBs in the financial services sector,...

  • Azure Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia InfoCentric Full time

    About the RoleWe are seeking a highly skilled Azure Data Engineer to join our team at InfoCentric. As a key member of our cloud computing team, you will be responsible for designing, implementing, and maintaining large-scale data engineering solutions on Azure.Key ResponsibilitiesDesign and implement data pipelines using Azure Synapse and Microsoft...