Senior Data Engineer

4 weeks ago

Brisbane, Australia Michael Page Full time
About Our Client

This globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Data led organisation by 2025.

A large part of this is building upon and enhancing their newly created Global Azure Data Platform, for which this role will play a lead part in delivering.

Job Description

Working within the group's core Data & Analytics function, this position will hold the following responsibilities:

  • Delivering technical functionality developed against the Global Azure Data Platform.
  • Creating and maintain optimal data pipeline architecture in Azure.
  • Drive best practice development and design, working with the wider team to implement solutions that deliver quality, usable insights to multiple business users and functions.
  • Assembling large, complex data sets that meet functional / non-functional business requirements.
  • Identifying, designing, and implementing internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc.
  • Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure 'big data' technologies.
  • Working with stakeholders including the Executive, Product and Data teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keeping internal data separated and secure across national boundaries through well architected sensitive data patterns and later enhancements to include regions in Azure.
  • Creating data tools for analytics and data scientist team members that assist them in building and optimising our product into an innovative industry leader.
  • Working with data and analytics experts to strive for greater functionality in data systems.



The Successful Applicant

Key skills and experience required:

  • Extensive commercial experience as a Senior data engineer experience leading Digital Data transformation programmes, including experience in Azure cloud development.
  • Expert experience with Azure Data Factory, Azure Databricks specifically
  • Experience with other Microsoft cloud services including Azure Logic Apps, Azure Functions, Azure Storage, Azure Data Lake, Synapse.
  • Involvement in or delivery of a successful multi regional digital data initiative.
  • Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimising 'big data' data pipelines, architectures and data sets.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • A successful history of manipulating, processing and extracting value from large, disconnected datasets.
  • Familiarity with data modelling architectures (Kimball/Inmon) and its implementation
  • Familiarity with metadata driven (contract) frameworks on cloud
  • Experience with version and source control (Git) and Azure DevOps
  • Experience in APIs and API Management

  • Senior Data Engineer

    1 week ago

    Brisbane, Queensland, Australia Randstad Australia Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platformKey Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a...

  • Senior Data Engineer

    7 days ago

    Brisbane, Queensland, Australia Randstad Australia Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platformKey Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a...

  • Senior Data Engineer

    5 days ago

    Brisbane, Australia HKT Full time

    This is a full-time position with hybrid working arrangement (1-2 days in office)  Role Overview We are passionate about harnessing the power of data to drive innovation and empower businesses. We are seeking a highly technical and experienced Senior Data Engineer to join our dynamic team. The successful candidate will be a key player in designing,...

  • Senior Data Engineer

    1 week ago

    Brisbane, Australia Randstad Australia Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client’s lake house platform!Key Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems...

  • Senior Data Engineer

    7 days ago

    Brisbane, Australia Randstad Australia Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client’s lake house platform!Key Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Australia HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...

  • Senior Data Engineer

    2 weeks ago

    Brisbane, Australia Suncorp Group Full time

    Drive the technical vision for implementing new cloud data platform on Databricks to support Data Warehousing, Data Science and Gen AI use cases Experience implementing Databricks along with defining patterns and frameworks Empower and guide a high performing, collaborative team We’re never just satisfied with how things are – because we know how...

  • Senior Data Engineer

    5 days ago

    Brisbane, Australia Suncorp Group Full time

    Drive the technical vision for implementing new cloud data platform on Databricks to support Data Warehousing, Data Science and Gen AI use cases Experience implementing Databricks along with defining patterns and frameworks Empower and guide a high performing, collaborative team We’re never just satisfied with how things are – because we know how...

  • Senior Data Engineer

    2 weeks ago

    Brisbane, Australia Michael Page Full time

    Permanent positionBrisbane CBD locationAbout Our ClientThis globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Data led organisation by 2025.A large part of this is building upon and enhancing their...

  • Senior Data Engineer

    5 days ago

    Brisbane, Australia Michael Page Full time

    Permanent positionBrisbane CBD locationAbout Our ClientThis globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Data led organisation by 2025.A large part of this is building upon and enhancing their...

  • Senior Data Migration Engineer | Enterprise

    1 week ago

    Brisbane, Australia KPMG Full time

    We are seeking a highly skilled Data Engineer to join the Data Migration team. The successful candidate will be responsible for developing ETLs on Azure Synapse to facilitate the migration of data from customers' on-premise applications to new SaaS-based systems. This role requires strong technical expertise in ETL processes, and Azure Data Factory /...

  • Senior Data Migration Engineer | Enterprise

    1 week ago

    Brisbane, Australia KPMG Full time

    We are seeking a highly skilled Data Engineer to join the Data Migration team. The successful candidate will be responsible for developing ETLs on Azure Synapse to facilitate the migration of data from customers' on-premise applications to new SaaS-based systems. This role requires strong technical expertise in ETL processes, and Azure Data Factory /...

  • Senior Data Scientist

    1 month ago

    Brisbane, Australia Troocoo Full time

    Troocoo:A client of ours in the financial services space is committed to leveraging data insights to drive strategic decision-making and enhance customer experiences. They are seeking a Senior Data Scientist who can use their skillset to influence how the organisation operates through the development of...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Australia Humanised Group Full time

    Are you a skilled Data Engineer/Developer looking for an exciting opportunity in the energy sector? Join our client’s dynamic project team and be part of a transformation with significant impact! 12 month contract position. Excellent day rate. Located right here in Brisbane’s CBD. Hybrid working arrangement. As the sole technical member in a team of...

  • Senior Data Engineer

    5 days ago

    Brisbane, Australia Humanised Group Full time

    Are you a skilled Data Engineer/Developer looking for an exciting opportunity in the energy sector? Join our client’s dynamic project team and be part of a transformation with significant impact! 12 month contract position. Excellent day rate. Located right here in Brisbane’s CBD. Hybrid working arrangement. As the sole technical member in a team of...

  • Data Engineer

    1 month ago

    Brisbane, Australia Suncorp Group Full time

    Full-time 12-month contract  Flexible working locations of Brisbane, Sydney or Melbourne Modern building with state of the art facilities At Suncorp, we're seeking a Data Engineer to play a pivotal role in delivering top-quality customer complaints data that drives our commitment to customers, communities, and shareholders. Your mission includes...

  • Senior Data Migration Engineer | Enterprise

    7 days ago

    Brisbane, Australia KPMGau Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join the Data Migration team. The successful candidate will be responsible for developing ETLs on Azure Synapse to facilitate the migration of data from customers' on-premise applications to new SaaS-based systems. This role requires strong technical expertise in ETL processes, and Azure Data...

  • Senior Data Migration Engineer | Enterprise

    6 days ago

    Brisbane, Australia KPMG Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join the Data Migration team. The successful candidate will be responsible for developing ETLs on Azure Synapse to facilitate the migration of data from customers' on-premise applications to new SaaS-based systems. This role requires strong technical expertise in ETL processes, and Azure Data...

  • Senior Data Scientist

    2 weeks ago

    Brisbane, Australia VGW Full time

    Senior Data Scientist  VGW is a fast-growing technology company and creator of market-leading online social games. With offices around the globe, we’re on a mission to be the biggest gaming company in the world! We are seeking a highly skilled and experienced Senior Data Scientist with Computer Vision experience to provide technical leadership and...

  • Data Network Engineer

    3 weeks ago

    Brisbane, Australia Queensland Rail Full time

    Our Telecommunications Systems Engineering team have a permanent opportunity for a Telecommunications Systems Officer (Data Network Engineer). This role works with a team of experienced Engineers and Specialists to deliver and support significant programs of work including QR’s Major Projects within Cross River Rail and European Train Control...