Azure Data Engineer

17 hours ago

Council of the City of Sydney, Australia HSO Enterprise Solutions GmbH Full time

Overview

As an Azure Data Engineer you can expect to…

- Design, build, and maintain data engineering solutions on Microsoft Azure and Fabric (Lakehouse, Warehouse, Data Factory, Synapse Analytics, Dataflows, Eventstreams).
- Coordinate sprints, daily stand-ups, and retrospective meetings as part of Agile delivery.
- Collaborate with business and technical teams to analyze, document, and validate requirements.
- Perform source system analysis and identify appropriate data ingestion and integration strategies for both batch and streaming pipelines.
- Develop and optimize ETL/ELT solutions using Azure Data Factory pipelines, Synapse pipelines, or Fabric Data Pipelines.
- Leverage services such as Azure Data Lake Storage (ADLS), Synapse Analytics, SQL Database, Azure Functions, Event Hub, Synapse Spark, and Microsoft Fabric (Lakehouse, Warehouse, Notebooks, Pipelines) for data integration and transformation.
- Write and optimize SQL, Python, and PySpark code for large-scale data processing.
- Implement data ingestion frameworks, incremental/delta loads, and medallion architecture patterns (Bronze/Silver/Gold).
- Connect and integrate diverse data sources (SQL, Oracle, ODBC, ERP, CRM, APIs, flat files, streaming events) into Fabric and Azure ecosystems.
- Ensure data quality, security, and governance in alignment with enterprise standards.
- Continuously research and adopt efficient methods for scalable data movement, transformation, and storage.
- Work independently and as part of a cross-functional team to deliver high-quality solutions.

Qualifications / You're great at…

- Working in Microsoft Fabric and Azure Data Services to design, build, and optimize enterprise-grade data pipelines
- Modern data engineering, advanced SQL/Spark skills, and working collaboratively in Agile environments
- Solving complex problems with creative solutions
- Learning new concepts quickly and thoroughly
- Promoting the mission and Shared Values of our company

#J-18808-Ljbffr

  • Data Engineer

    3 weeks ago

    Council of the City of Ryde, Australia DWS Full time

    Please complete the form below to apply for this positionResumeFirst nameLast nameEmailPhone1. What work rights do you hold for Australia? (DWS are unable to sponsor visas)2. How many years' experience do you have in Data / Analytics / Business Intelligence (BI)?3. Which of these Business Intelligence (BI) tools do you have experience with? Microsoft SQL...

  • Azure Data Engineer

    2 weeks ago

    Tweed Shire Council, Australia Care Connect - Community Care Provider Full time

    OverviewJoin a purpose-driven organisation that provides vital home and community care services. Care Connect is seeking an experienced Azure Data Engineer to help shape and manage our data infrastructure and enable better decision-making that improves outcomes for the people we support.An industry-leading and dynamic support provider, Care Connect is...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Azure Data Platform Engineer

    6 days ago

    Sydney, New South Wales, Australia Virtusa Full time $120,000 - $180,000 per year

    Job SummaryWe are seeking a highly skilled and proactive Azure Data Platform Engineer to design, implement, and manage robust data solutions on Microsoft Azure. The ideal candidate will have deep expertise in Azure Synapse, Azure Databricks, Azure Fabric, and cloud infrastructure administration. This role involves maintaining server health, managing...

  • Microsoft Azure Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Buscojobs Full time

    We are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining data architecture, models, and standards for Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are integrated with existing structures to provide a consistent view. Develop and maintain documentation of data architecture,...

  • Senior Data Engineer

    2 weeks ago

    Sydney, City Of Brisbane, Australia beBeeDataEngineer Full time $120,000 - $160,000

    About the RoleWe are seeking an experienced data engineer to lead innovative, end-to-end solutions. This role offers the opportunity to design and automate data pipelines using Azure ADF, SQL, REST APIs, and Blob Storage.Design and automate data pipelines ensuring high data quality and reliabilityDevelop and deploy AI and automation solutions using AI...

  • Azure Data Analyst

    1 week ago

    Sydney, Australia Virtusa Full time

    As an Azure Databricks Architect, you will lead the design and implementation of scalable, secure, and high-performance data platforms using Azure Databricks. You will work closely with insurance clients to modernize their data ecosystems, enabling advanced analytics and AI-driven insights. Key responsibilities include architecting and implementing...

  • Azure Cloud Engineer

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDevOps Full time $180,000 - $250,000

    DevOps Engineer RoleWe are seeking a highly skilled DevOps Specialist to join our team. The successful candidate will have expertise in designing and developing scalable data pipelines using Azure Databricks, PySpark, and SQL.Main ResponsibilitiesData Pipeline Development: Implement structured streaming, Delta Lake, and Unity Catalog solutions.Optimization...