Senior Data Engineer

2 weeks ago

Brisbane, Queensland, Australia PM Consulting (Qld) Pty Ltd Full time

2 days ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Working with our client, the Senior Data Engineer will be responsible for architecting and implementing robust data solutions on a contract basis. You will focus on building efficient data pipelines, ensuring data accessibility, and optimizing performance using SQL, Microsoft Fabric (Azure's unified analytics platform), and Python. This position is designed for an experienced professional who can hit the ground running, with an anticipated duration of 5 months (anticipated start on 29 th Sept – 27 February 2026)

Key Responsibilities

  • Develop and maintain scalable ETL processes using Python, integrating data from diverse sources.
  • Design and manage data architectures within Microsoft Fabric, including data lakes, pipelines, and analytics workspaces.
  • Craft advanced SQL queries to handle data extraction, transformation, and loading in large-scale databases.
  • Collaborate with data teams and stakeholders to translate business needs into technical data solutions.
  • Implement data quality checks, governance, and security measures to ensure compliance and reliability.
  • Optimise data workflows for performance, troubleshooting issues in real-time processing and batch jobs.
  • Integrate APIs, cloud services, and external data feeds into the ecosystem.
  • Provide documentation and knowledge transfer to support seamless handover at contract end.

Required Qualifications and Skills:

  • Bachelor's or Master's degree in Computer Science, Information Systems, or a related discipline.
  • At least 5 years of data engineering experience, with 2+ years in a senior capacity.
  • Strong proficiency in SQL for complex querying, database design, and optimization (e.g., in Azure SQL or similar).
  • Extensive hands-on experience with Microsoft Fabric, encompassing Azure Data Factory, Synapse Analytics, and Power BI integrations.
  • Expertise in Python for data manipulation, automation, and scripting (utilizing libraries such as Pandas, NumPy, or Spark).
  • Solid knowledge of Azure cloud services and data engineering best practices.
  • Ability to work autonomously-, delivering results under deadlines.
  • Excellent analytical and communication skills for cross-team interactions.

Preferred Skills:

  • Experience with big data tools like Apache Spark or Databricks.
  • Familiarity with CI/CD pipelines, Git, and agile development.
  • Knowledge of additional Azure components, such as Blob Storage or Event Hubs.
Seniority level
  • Seniority levelMid-Senior level
Employment type
  • Employment typeContract
Job function
  • Job functionInformation Technology

Referrals increase your chances of interviewing at PM Consulting (Qld) Pty Ltd by 2x

Get notified about new Senior Data Engineer jobs in Nundah, Queensland, Australia.

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 2 weeks ago

Brisbane, Queensland, Australia 3 days ago

Brisbane, Queensland, Australia A$120,000.00-A$150,000.00 2 days ago

Brisbane, Queensland, Australia 1 week ago

Data Applications Developer (Senior) - Business Intelligence

Brisbane, Queensland, Australia 1 month ago

Brisbane, Queensland, Australia 5 days ago

Brisbane, Queensland, Australia 4 days ago

Murarrie, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 6 days ago

Brisbane City, Queensland, Australia 2 months ago

Brisbane City, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 2 weeks ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 3 days ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 2 weeks ago

Senior Software Engineer - Digital Workplace

Brisbane, Queensland, Australia 3 days ago

Brisbane, Queensland, Australia 2 months ago

Brisbane, Queensland, Australia 1 week ago

Senior Software Engineer - Frontend (Open to remote across ANZ)

Brisbane, Queensland, Australia 6 days ago

Brisbane, Queensland, Australia 1 week ago

Brisbane City, Queensland, Australia 1 week ago

Senior Principal Software Engineer - Platform Engineering

Brisbane, Queensland, Australia 4 weeks ago

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Brisbane, Queensland, Australia 6 months ago

Brisbane, Queensland, Australia 1 day ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 3 weeks ago

Embedded Linux Senior Software Engineer - Optimisation

Brisbane, Queensland, Australia 1 month ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 1 week ago

Brisbane, Queensland, Australia 4 days ago

Brisbane, Queensland, Australia 4 days ago

Senior Software Engineer (Typescript/Node/React/AWS)

Brisbane, Queensland, Australia 6 days ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Senior Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia PM Consulting (Qld) Pty Ltd Full time

    2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Working with our client, the Senior Data Engineer will be responsible for architecting and implementing robust data solutions on a contract basis. You will focus on building efficient data pipelines, ensuring data accessibility, and optimizing performance...

  • Senior Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia QIC Full time

    Join to apply for the Senior Data Engineer role at QICJoin to apply for the Senior Data Engineer role at QICAbout QICAs one of Australias leading institutional investment managers with more than $100 billion in assets under management, we have a presence across four continents, seven offices and assets across global markets.About QICAs one of Australias...

  • Senior Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia Exclaim IT Full time

    Join to apply for the Senior Data Engineer role at Exclaim IT1 day ago Be among the first 25 applicants Join to apply for the Senior Data Engineer role at Exclaim ITGet AI-powered advice on this job and more exclusive features.This range is provided by Exclaim IT.Your actual pay will be based on your skills and experience — talk with your recruiter to...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Endava Full time

    Join to apply for the Senior Data Engineer - Python & Databricks role at Endava20 hours ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer - Python & Databricks role at EndavaCompany DescriptionTechnology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.Company...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Endava Full time

    Join to apply for the Senior Data Engineer - Python & Databricks role at Endava20 hours ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer - Python & Databricks role at EndavaCompany DescriptionTechnology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.Company...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Fusion5 Full time

    Join to apply for the Senior Data Engineer role at Fusion51 day ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at Fusion5Direct message the job poster from Fusion5Drive outcomes, build trust, and grow your career with Fusion5Design, Define and DeliverJoin a leading Transformation partnerJoin a leading systems integrator...

  • Senior Data Engineer

    4 weeks ago

    Brisbane, Queensland, Australia Fusion5 Full time

    Join to apply for the Senior Data Engineer role at Fusion51 day ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at Fusion5Direct message the job poster from Fusion5Drive outcomes, build trust, and grow your career with Fusion5Design, Define and DeliverJoin a leading Transformation partnerJoin a leading systems integrator...

  • Senior Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia SS&C Technologies Full time

    As a leading financial services and healthcare technology company based on revenue, SS&C is headquartered in Windsor, Connecticut, and has 27,000+ employees in 35 countries.Some 20,000 financial services and healthcare organizations, from the world's largest companies to small and mid-market firms, rely on SS&C for expertise, scale, and technology.Job...

  • Senior Data Engineer

    5 minutes ago

    Brisbane, Queensland, Australia Selectplanthire Full time

    About Laing O'RourkeLaing O'Rourke is a $6 billion international operation with 70 years of involvement in Australian construction and infrastructure, including nearly two decades under the Laing O'Rourke banner.The business delivers projects as diverse as the environments in which they are built, from high security military bases and major rail transport...

  • Senior Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia SS&C Technologies Full time

    As a leading financial services and healthcare technology company based on revenue, SS&C is headquartered in Windsor, Connecticut, and has 27,000+ employees in 35 countries. Some 20,000 financial services and healthcare organizations, from the world's largest companies to small and mid-market firms, rely on SS&C for expertise, scale, and technology.Job...