Senior Azure Data Engineer

9 hours ago

Sydney, New South Wales, Australia M&T Resources Full time

Job Title: Senior Azure Data Engineer

Job Summary: We are seeking a highly skilled Senior Azure Data Engineer to lead the migration of our clients' legacy on-premises data warehouse to a cutting-edge data platform on Azure.

Key Responsibilities:

  • Lead the migration from on-premises data warehouses to Azure-based data platforms.
  • Design and build fully automated end-to-end data pipelines in Azure using PySpark and other cloud-native technologies.
  • Collaborate with stakeholders to integrate BI reports, UDAs, downstream systems, and third-party data feeds.
  • Optimize SQL for performance in a cloud data warehouse environment and ensure smooth data flows between systems.
  • Work with both structured and unstructured data types (JSON, XML, AVRO) and handle high-volume batch and near real-time data processing.
  • Contribute to the creation of data products, data mesh architectures, and modern cloud data solutions.

Requirements:

  • 7+ years of experience in Data Warehousing and Data Engineering within the banking sector.
  • At least 2 years of hands-on experience designing and delivering data engineering solutions with PySpark in Azure.
  • Proven experience in large data migrations and setting up data platforms in the cloud (Azure).
  • Expertise in building automated, scalable data pipelines and advanced SQL for data warehouses, Big Data, and Data Bricks.
  • Proficiency with Big Data tools like Spark (Python/Scala) and experience in cloud data warehouses (Azure Synapse, Data Lake, etc.).
  • Hands-on experience with CI/CD processes using tools such as Bitbucket/GitHub, Jenkins, and Nexus.
  • Experience working with modern architectures, including microservices, REST APIs, and data-as-a-service frameworks.
  • Knowledge of decentralized data architecture – Data Mesh.

  • Senior Data Engineer – Azure

    7 days ago

    Sydney, New South Wales, Australia M&T Resources Full time

    SydneyIT & Telecomms DBA / Database DeveloperBig 4 banking experience highly beneficialAzure / Data Migration/ Pyspark / Data WarehousingHybrid working environment / Day Rate contractWe're seeking a Senior Data Engineer to lead the migration of our clients legacy on-premises data warehouse to a cutting-edge data platform on Azure. This is a unique...

  • Senior Data Migration Engineer

    4 days ago

    Sydney, New South Wales, Australia M&T Resources Full time

    Job Title: Senior Data Migration Engineer - AzureAbout the Role:We are seeking a highly experienced Senior Data Migration Engineer to lead the migration of our clients' legacy on-premises data warehouse to a cutting-edge data platform on Azure. This is a unique opportunity to work on large data engineering projects within the banking sector, delivering...

  • Azure Data Engineer

    1 month ago

    Sydney, New South Wales, Australia Ethos BeathChapman Full time

    Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at Ethos BeathChapman. As a key member of our data engineering team, you will be responsible for designing, developing, and unit testing data movement, transformation, and visualization processes across multiple data sources.Key ResponsibilitiesDesign and develop ETL/ELT...

  • Senior Data Engineer

    6 days ago

    Sydney, New South Wales, Australia BaptistCare Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at BaptistCare. As a Senior Data Engineer, you will be responsible for designing, implementing, and optimizing data pipelines on Azure Data Platform for reporting.You will work closely with our Data and Analytics team to deliver and implement detailed designs across various...

  • Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Green Light Full time

    About the RoleWe are seeking a highly skilled Data Engineer with over 5 years of experience to join our client's team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and ETL processes in Azure.Key ResponsibilitiesDesign and develop data pipelines and ETL processes in Azure to support analytics,...

  • Senior Data Engineer

    1 day ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to design, implement, and support telemetry systems and reporting solutions within our IT environments. The...

  • Senior Data Engineer

    1 month ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team, promoting an inclusive workplace that values diversity and delivers meaningful benefits for our people, clients and communities.About the RoleWe are...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.We are passionate about creating an inclusive workplace that promotes and values diversity, and our mission is to attract, retain and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.We are passionate about creating an inclusive workplace that promotes and values diversity, and our mission is to attract, retain and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team, creating an inclusive workplace that promotes and values diversity.About the RoleWe are seeking a Senior Data Engineer to design, implement and...

  • Senior Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.We are passionate about creating an inclusive workplace that promotes and values diversity, and our mission is to attract, retain and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to...

  • Azure Data Engineer

    1 month ago

    Sydney, New South Wales, Australia InfoCentric Full time

    About the RoleWe are seeking a skilled Azure Data Engineer to join our team at InfoCentric, a leading specialist Cloud, Data and Analytics Consulting firm. As a key member of our team, you will be responsible for designing, implementing, and maintaining large-scale data systems on the Azure platform.Key ResponsibilitiesDesign and develop data architectures...

  • Senior Data Engineer

    5 days ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About Us:CDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Headquartered in Canberra, our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute environments with all campuses interconnected with high-speed carrier grade...

  • Senior Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Established in 2007, we have a strong presence in the ACT, NSW, and New Zealand, with a diverse range of operations that support co-location, containerised, and hyperscale compute environments.We are committed to creating an inclusive...

  • Senior Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our company was established in 2007 and has since grown to become a major player in the industry.We are headquartered in Canberra and have multiple facilities in the ACT, NSW, and New Zealand. Our diversified operations provide secure data...

  • Azure Databricks Data Engineer

    1 day ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    About the RoleXPT Software Australia Pty Ltd is seeking a highly skilled Azure Databricks Data Engineer to join our team.Key ResponsibilitiesDesign, develop, and maintain large-scale data processing pipelines using Azure Databricks.Collaborate with cross-functional teams to integrate data engineering solutions with business requirements.Develop and maintain...

  • Senior Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.About the RoleWe are seeking a Senior Data Engineer to design, implement and support telemetry systems and reporting solutions within our IT Environments.Key ResponsibilitiesDesign, implement and support complex data processing...

  • Azure Databricks Data Engineer

    3 days ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    Job DescriptionDetailed JD *(Roles and Responsibilities)We are seeking a highly skilled Azure Databricks Data Engineer to join our team at XPT Software Australia Pty Ltd.Key Responsibilities• Design, develop, and maintain large-scale data processing pipelines using Azure Databricks and Azure Data Lake.• Collaborate with cross-functional teams to identify...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Echo Entertainment Group Full time

    Senior Data EngineerAt Echo Entertainment Group, we are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a pivotal role in shaping the success of our training and development offer for every team member.Key Responsibilities:Provide estimates for new design and development work, collaborating with...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Echo Entertainment Group Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Echo Entertainment Group. As a Senior Data Engineer, you will play a pivotal role in shaping the success of our training and development offer for every team member.Key Responsibilities:Design and implement Data Platform and Data Integration Platform development...