Azure Data Engineer

2 months ago

Sydney, Australia M&T Resources Full time

Sydney

IT & Telecomms DBA / Database Developer

  • Big 4 banking experience highly beneficial
  • Azure / Data Migration/ Pyspark / Data Warehousing
  • Hybrid working environment / Day Rate contract

Are you an experienced Senior Data Engineer with a passion for driving large scale data migrations? Do you have a strong background in building data platforms and automated pipelines in Azure? If so, we want to hear from you
  
We’re seeking a Senior Azure Data Engineer to lead the migration of our clients legacy on-premises data warehouse to a cutting-edge data platform on Azure. This is a unique opportunity to work on large data engineering project within the banking sector, delivering solutions that support reporting, analytics, and a variety of downstream systems and third-party data feeds.
  
Key Responsibilities:

  • Lead the migration from on prem data warehouses to Azure based data platforms.
  • Design and build fully automated end-to-end data pipelines in Azure using PySpark and other cloud-native technologies.
  • Collaborate with stakeholders to integrate BI reports, UDAs, downstream systems, and third-party data feeds.
  • Optimise SQL for performance in a cloud data warehouse environment and ensure smooth data flows between systems.
  • Work with both structured and unstructured data types (JSON, XML, AVRO) and handle high-volume batch and near real-time data processing.
  • Contribute to the creation of data products, data mesh architectures, and modern cloud data solutions

  
What We’re Looking For:

  • 7+ years of experience in Data Warehousing and Data Engineering within the banking sector.
  • At least 2 years of hands-on experience designing and delivering data engineering solutions with PySpark in Azure.
  • Proven experience in large data migrations and setting up data platforms in the cloud (Azure).
  • Expertise in building automated, scalable data pipelines and advanced SQL for data warehouses, Big Data, and Data Bricks.
  • Proficiency with Big Data tools like Spark (Python/Scala) and experience in cloud data warehouses (Azure Synapse, Data Lake, etc.).
  • Hands-on experience with CI/CD processes using tools such as Bitbucket/GitHub, Jenkins, and Nexus.
  • Experience working with modern architectures, including microservices, REST APIs, and data-as-a-service frameworks.
  • Knowledge of decentralised data architecture – Data Mesh

If you feel you meet most of the requirements, I would love to hear from you – if you have any questions, please email kiernan.mcneill@mtr.com.au

Apply Now

  • Senior Azure Data Engineer

    9 months ago

    North Sydney, Australia NTT DATA Full time

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...

  • Sydney Azure Data Engineer

    1 day ago

    Sydney, New South Wales, Australia INGRITY Full time

    About the Role">INGRITY is a fast-growing data and analytics company based in Sydney, offering an exciting opportunity for a talented Azure Data Engineer to join our team in the Banking/Financial Services or Insurance sector.We are seeking an experienced professional to collaborate closely with our prestigious clients in these industries, contributing to...

  • Data Engineering Specialist

    4 weeks ago

    Sydney, New South Wales, Australia One51 Consulting Full time

    We are seeking a highly skilled Data Engineering Specialist to join our team as an Azure Cloud Architect. This role will be responsible for designing and developing data architectures, models, and standards for various Data Integration & Data Warehouse projects in Azure.Key Responsibilities:Design and develop ETL pipelines in and out of a data warehouse...

  • Data Engineer Lead for Azure Platform

    1 month ago

    Sydney, New South Wales, Australia BaptistCare Full time

    BaptistCare is seeking a highly skilled Data Engineer Lead to join its growing team in Norwest.As a key member of the Data & Analytics team, you will be responsible for designing, implementing and optimising Azure data platforms to drive business growth and improve operational efficiency.The ideal candidate will have extensive experience with Azure Data...

  • Azure Data Solutions Specialist

    4 weeks ago

    Sydney, New South Wales, Australia INGRITY Full time

    About INGRITYWe are a progressive data and analytics company delivering actionable insights to drive impact.Our team has seen success in leading and delivering major data transformation programs in large and medium enterprises in Australia.We assist our clients in improving their internal data and analytics capabilities and think innovatively about solving...

  • Azure Big Data

    7 months ago

    Sydney, Australia Cognizant Full time

    Do you have Azure experience and are you seeking a new job? Cognizant is recruiting an Azure Big Data Engineer. - Working knowledge in Azure services ADF, ADLS, Event Hub, cosmosDB, Azure Databricks - Knowledge of CICD - Git / Bitbucket, Jenkins / Bamboo - Have experience in executing Hive/Impala SQLs - Sound knowledge on Spark Query tuning and performance...

  • Highly Experienced Azure Solutions Architect for Data Engineering

    4 weeks ago

    Sydney, New South Wales, Australia INGRITY Full time

    About the RoleWe are seeking a highly skilled Azure Solutions Architect with extensive expertise in data engineering to join our team. As a key member of our organization, you will have the unique opportunity to collaborate closely with prestigious clients and contribute to their success.Your ResponsibilitiesCollaborate with Clients and Stakeholders: Work...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia INGRITY Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team in Sydney, Australia. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Microsoft Fabric tools such as Data Factory and Lakehouse.Key ResponsibilitiesDevelop and maintain complex...

  • Senior Data Engineering Leader for Large-Scale Azure Project

    1 month ago

    Sydney, New South Wales, Australia The Recruitment Company Full time

    About The Role:The Recruitment Company is seeking an experienced Senior Data Engineer to join a high-profile project in Australia.As a Senior Data Engineer, you will be responsible for collaborating with a wider team to establish a modern lakehouse data platform using Microsoft Fabric, ingesting validating and reporting on high-value client data.This is an...

  • Data Solutions Architect

    4 weeks ago

    North Sydney Council, Australia NTT DATA Full time

    About the Company">NTT DATA is a leading IT services provider that empowers its clients to navigate the complexities of an ever-evolving technology landscape. With a strong presence in the APAC region and globally, we are committed to delivering cutting-edge analytical solutions that drive business growth and innovation.">Overview">We are seeking an...

  • Principal Data Engineer

    1 month ago

    Sydney, Australia Talent Insights Full time

    Microsoft Azure, Databricks, Data Factory and Gen AI applications Hybrid, flexible work Opportunity to lead and shape a DE function, greenfield project Principal / Lead Data Engineer ( Microsoft Azure /...

  • Project Manager

    4 weeks ago

    Sydney, Australia INGRITY Full time

    Drive Innovation with Azure: Lead, Deliver, Transform... Join Our Team as an Azure Data Platform Project Manager!Are you passionate about driving innovation and delivering impactful data solutions? Step into a role where you’ll lead projects, collaborate with dynamic teams, and leverage cutting-edge Azure technologies. If you’re ready to make a...

  • Project Manager

    1 month ago

    Sydney, Australia INGRITY Remote Work Freelance Full time

    Drive Innovation with Azure: Lead, Deliver, Transform... Join Our Team as an Azure Data Platform Project Manager!Are you passionate about driving innovation and delivering impactful data solutions? Step into a role where you’ll lead projects, collaborate with dynamic teams, and leverage cutting-edge Azure technologies. If you’re ready to make a...

  • Azure Data Solutions Leader

    4 weeks ago

    Sydney, New South Wales, Australia INGRITY Full time

    About the RoleWe are seeking a highly skilled Azure/ Data Platform Project Manager to lead and deliver data-driven projects using Microsoft Azure technologies. This individual will be responsible for overseeing the development, deployment, and maintenance of Azure data solutions, ensuring data platform performance, scalability, and security.Key...

  • Data Engineer: Cloud Data Solutions Expert

    1 month ago

    Sydney, New South Wales, Australia Neilson Financial Services Full time

    Job Title: Data Engineer: Cloud Data Solutions Expert We are seeking a skilled Data Engineer to join our team at Neilson Financial Services. This role will involve designing, building, and maintaining cloud-based data solutions using Azure services such as Azure Data Factory, Azure SQL Database, and Power BI. About the Role:Design, develop, and maintain...

  • Azure Data Platform Project Manager

    2 weeks ago

    Sydney, New South Wales, Australia INGRITY Full time

    About INGRITYWe are a fast-growing, progressive data & analytics company based in Sydney. We service large corporates and small to medium-sized businesses in the financial services sector, helping them derive value from their data.Job DescriptionThis role involves leading and delivering data-driven projects using Microsoft Azure technologies. As an ideal...

  • Senior Data Engineer

    1 month ago

    North Sydney, Australia Bluefin Resources Full time

    Full TimeSydney: Hybrid workingSalary: up to $160k, plus super (depending on experience)We are seeking a Senior Data Engineer to join a dynamic team within a forward-thinking organisation leveraging cutting-edge data technologies. If you are passionate about data engineering, have strong mentoring skills, and excel in stakeholder engagement, this opportunity...

  • Strategic Azure Data Platform Project Lead

    4 weeks ago

    Sydney, New South Wales, Australia INGRITY Full time

    About the Company: INGRITY is a Microsoft data and AI solution partner, working closely with Microsoft to create value for our customers.We are a fast-growing, progressive Sydney-based data & analytics company. We service many large corporates and SMBs in the financial services sector, to derive value from data.Job Summary:We are seeking an experienced...

  • Azure Data Test Analyst

    7 hours ago

    Sydney, Australia Interface Agency Full time

    Contract Sydney, CBD - Remote - About the job - We are working with a leading organisation in the financial services industry. They are transforming their business by being data lead, utilising their big data to make customer centric decisions. But first they need to create an advanced data platform, they are moving away from their legacy data platform to a...

  • Microsoft Technology Specialist

    6 months ago

    Sydney, Australia Microsoft Full time

    Overview Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where...