Senior Data Engineer

1 month ago

Brisbane, Australia Michael Page Full time
About Our Client

This globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Data led organisation by 2025.

A large part of this is building upon and enhancing their newly created Global Azure Data Platform, for which this role will play a lead part in delivering.

Job Description

Working within the group's core Data & Analytics function, this position will hold the following responsibilities:

  • Delivering technical functionality developed against the Global Azure Data Platform.
  • Creating and maintain optimal data pipeline architecture in Azure.
  • Drive best practice development and design, working with the wider team to implement solutions that deliver quality, usable insights to multiple business users and functions.
  • Assembling large, complex data sets that meet functional / non-functional business requirements.
  • Identifying, designing, and implementing internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc.
  • Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure 'big data' technologies.
  • Working with stakeholders including the Executive, Product and Data teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keeping internal data separated and secure across national boundaries through well architected sensitive data patterns and later enhancements to include regions in Azure.
  • Creating data tools for analytics and data scientist team members that assist them in building and optimising our product into an innovative industry leader.
  • Working with data and analytics experts to strive for greater functionality in data systems.



The Successful Applicant

Key skills and experience required:

  • Extensive commercial experience as a Senior data engineer experience leading Digital Data transformation programmes, including experience in Azure cloud development.
  • Expert experience with Azure Data Factory, Azure Databricks specifically
  • Experience with other Microsoft cloud services including Azure Logic Apps, Azure Functions, Azure Storage, Azure Data Lake, Synapse.
  • Involvement in or delivery of a successful multi regional digital data initiative.
  • Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimising 'big data' data pipelines, architectures and data sets.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • A successful history of manipulating, processing and extracting value from large, disconnected datasets.
  • Familiarity with data modelling architectures (Kimball/Inmon) and its implementation
  • Familiarity with metadata driven (contract) frameworks on cloud
  • Experience with version and source control (Git) and Azure DevOps
  • Experience in APIs and API Management

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia Blackroc Full time

    BLACKROC are seeking a Senior Data Engineer for a global technology business who will play a crucial role in designing, building, and optimising data infrastructures, collaborating with senior stakeholders and mentoring team members.You'll be joining a newly formed team charged with owning, operating and improving mission-critical data infrastructure that's...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Randstad Australia Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platformKey Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia Randstad Australia Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platformKey Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Randstad Australia Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platformKey Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a...

  • senior data engineer

    5 days ago

    Brisbane, Queensland, Australia Randstad Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platformKey Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a...

  • Senior Data Engineer

    2 weeks ago

    Brisbane, Australia HKT Full time

    This is a full-time position with hybrid working arrangement (1-2 days in office)  Role Overview We are passionate about harnessing the power of data to drive innovation and empower businesses. We are seeking a highly technical and experienced Senior Data Engineer to join our dynamic team. The successful candidate will be a key player in designing,...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia HKT Full time

    This is a full-time position with hybrid working arrangement (1-2 days in office) Role Overview We are passionate about harnessing the power of data to drive innovation and empower businesses. We are seeking a highly technical and experienced Senior Data Engineer to join our dynamic team. The successful candidate will be a key player in designing,...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia HTK Full time

    This is a Full-time position with a Hybrid working model.About Console ConnectConsole Connect by PCCW Global focuses on simplifying business connectivity to the cloud, offering dedicated and secure connections to cloud service providers worldwide. It is the pioneer global software-defined interconnection platform, making business connectivity more accessible...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia HUMANISED GROUP Full time

    Are you a skilled Data Engineer/Developer looking for an exciting opportunity in the energy sector? Join our client's dynamic project team and be part of a transformation with significant impact12 month contract position.Located right here in Brisbane's CBD.Hybrid working arrangement.As the sole technical member in a team of 3-4, you'll collaborate closely...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia Compare the Market Full time

    Engineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights This job ad is the universe's way of telling you that you're currently in the wrong job.Compare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey. We are focused on...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia BAE Systems Full time

    Job Details Here's how the job details align with your profile. Job Type Permanent Full-time Location Australia Full Job Description At BAE Systems Australia Do meaningful work that MATTERS ENJOY what you do GROW your career Be YOURSELF We operate in a thriving sector that leads us to exciting and valuable work. Each day, we innovate to...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Australia Randstad Australia Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client’s lake house platform!Key Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Australia Randstad Australia Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client’s lake house platform!Key Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia HUMANISED GROUP Full time

    Are you a skilled Data Engineer/Developer looking for an exciting opportunity in the energy sector? Join our client's dynamic project team and be part of a transformation with significant impact12 month contract position.Located right here in Brisbane's CBD.Hybrid working arrangement.As the sole technical member in a team of 3-4, you'll collaborate closely...

  • Senior Data Engineer

    1 month ago

    Brisbane, Australia HKT Full time

    This is a Full-time position with a Hybrid working model. About Console Connect Connecting networks, clouds and businesses, Console Connect by PCCW Global is dedicated to helping organizations overcome the barriers and complexity of connecting to the cloud. Our goal is to provide businesses with on-demand, dedicated connectivity into cloud service...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia Humanised Group Full time

    Are you a skilled Data Engineer/Developer searching for an exciting opportunity in the energy sector? Join our client's dynamic project team and be part of a transformation with significant impact.12-month contract position.Excellent day rate.Located in Brisbane's CBD.Hybrid working arrangement.As the sole technical member in a team of 3-4, you'll...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia Randstad Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platformKey Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a...

  • Senior Data Engineer

    5 days ago

    Brisbane, Queensland, Australia Suncorp Group Full time

    Drive the technical vision for implementing new cloud data platform on Databricks to support Data Warehousing, Data Science and Gen AI use cases Experience implementing Databricks along with defining patterns and frameworks Empower and guide a high performing, collaborative team We're never just satisfied with how things are – because we know how...

  • Senior Data Engineer

    4 weeks ago

    Brisbane, Australia Suncorp Group Full time

    Drive the technical vision for implementing new cloud data platform on Databricks to support Data Warehousing, Data Science and Gen AI use cases Experience implementing Databricks along with defining patterns and frameworks Empower and guide a high performing, collaborative team We’re never just satisfied with how things are – because we know how...

  • Senior Data Engineer

    2 weeks ago

    Brisbane, Australia Suncorp Group Full time

    Drive the technical vision for implementing new cloud data platform on Databricks to support Data Warehousing, Data Science and Gen AI use cases Experience implementing Databricks along with defining patterns and frameworks Empower and guide a high performing, collaborative team We’re never just satisfied with how things are – because we know how...