Azure Data Engineer

3 weeks ago


Council of the City of Sydney, Australia HSO Enterprise Solutions GmbH Full time

Overview

As an Azure Data Engineer you can expect to…

- Design, build, and maintain data engineering solutions on Microsoft Azure and Fabric (Lakehouse, Warehouse, Data Factory, Synapse Analytics, Dataflows, Eventstreams).
- Coordinate sprints, daily stand-ups, and retrospective meetings as part of Agile delivery.
- Collaborate with business and technical teams to analyze, document, and validate requirements.
- Perform source system analysis and identify appropriate data ingestion and integration strategies for both batch and streaming pipelines.
- Develop and optimize ETL/ELT solutions using Azure Data Factory pipelines, Synapse pipelines, or Fabric Data Pipelines.
- Leverage services such as Azure Data Lake Storage (ADLS), Synapse Analytics, SQL Database, Azure Functions, Event Hub, Synapse Spark, and Microsoft Fabric (Lakehouse, Warehouse, Notebooks, Pipelines) for data integration and transformation.
- Write and optimize SQL, Python, and PySpark code for large-scale data processing.
- Implement data ingestion frameworks, incremental/delta loads, and medallion architecture patterns (Bronze/Silver/Gold).
- Connect and integrate diverse data sources (SQL, Oracle, ODBC, ERP, CRM, APIs, flat files, streaming events) into Fabric and Azure ecosystems.
- Ensure data quality, security, and governance in alignment with enterprise standards.
- Continuously research and adopt efficient methods for scalable data movement, transformation, and storage.
- Work independently and as part of a cross-functional team to deliver high-quality solutions.

Qualifications / You're great at…

- Working in Microsoft Fabric and Azure Data Services to design, build, and optimize enterprise-grade data pipelines
- Modern data engineering, advanced SQL/Spark skills, and working collaboratively in Agile environments
- Solving complex problems with creative solutions
- Learning new concepts quickly and thoroughly
- Promoting the mission and Shared Values of our company

#J-18808-Ljbffr


  • Azure Data Engineer

    7 days ago


    City of Melbourne, Australia Ayan Infotech Full time

    Overview AYAN InfoTech is looking for Azure Data Engineer to join an exciting project based in Melbourne. The role offers you the opportunity to contribute towards an extremely well structured and mature environment, working on sophisticated enhancement projects. Role: Azure Data Engineer Location: Melbourne Contract Duration: 6 Months with high possible...


  • Council of the City of Sydney, Australia Arinco Full time

    Overview Arinco is a leading Australian and New Zealand technology consulting business specialising in digital transformation for enterprise and SMB's. We live and breathe the Microsoft ecosystem, and we proudly deliver market leading solutions to our customers in partnership with them. Last year we were announced as their 2024 Australian Partner of the...

  • Data Engineer

    1 week ago


    Council of the City of Sydney, Australia GrainCorp Full time

    Overview GrainCorp is currently seeking a Data Engineer to join a motivated and collaborative team delivering data, infrastructure, and system activities to support advanced analytic use cases. You’ll have the opportunity to work from multiple exciting AI and IoT projects and be trained by experts who’ve been in this space for...


  • Council of the City of Sydney, Australia Paxus - Technology + Digital Talent Full time

    Data Engineer (Data Platforms) / Platform Engineer – Cloud, DevSecOps, and Automation Join a leading organisation driving the next generation of enterprise data and analytics platforms. As a Platform Engineer, you will play a key role in transforming one of Australia’s largest data ecosystems into a scalable, secure, and cloud-native environment. This...


  • Sydney, New South Wales, Australia Virtusa Full time $120,000 - $180,000 per year

    Job SummaryWe are seeking a highly skilled and proactive Azure Data Platform Engineer to design, implement, and manage robust data solutions on Microsoft Azure. The ideal candidate will have deep expertise in Azure Synapse, Azure Databricks, Azure Fabric, and cloud infrastructure administration. This role involves maintaining server health, managing...


  • Council of the City of Sydney, Australia HSO Enterprise Solutions GmbH Full time

    Overview As a Senior Azure Integration Engineer you can expect to… - Architect, develop, and implement end-to-end integration solutions using Azure services (Logic Apps, API Management, Service Bus) - Translate complex business requirements into scalable, secure integration architectures - Lead technical discussions, client workshops, and integration...

  • Azure Data Consultant

    2 weeks ago


    City of Melbourne, Australia Arinco Full time

    Who are you and what you’ll do We/'re a curious bunch who are passionate about producing quality engineering solutions across the Microsoft ecosystem. We look for people who love playing with or hearing about technologies be it through their home lab, heading to a meetup, researching content online or gaining a new cert - it/'s this desire to continue to...


  • Council of the City of Sydney, Australia Microsoft Corporation Full time

    Overview Storage, the core of Microsoft's Azure Cloud, provides 10 exabytes of capacity across 50 regions, 100+ data centers, and over 1000 storage clusters. It powers millions of virtual machines, holds millions of hours of video, billions of photos, and vast amounts of analytics data. As a Principal Software Engineer - Azure Storage, you will play a key...


  • Council of the City of Sydney, Australia Microsoft Corporation Full time

    Overview Are you excited about the possibility of working on the largest Cloud Storage service in the world? Azure Storage team is chartered with building, managing and running the Persistent Cloud Storage for Microsoft Azure Cloud. Azure Storage consists of a Storage Platform which currently powers five different storage services – Blob Storage, Table...


  • Council of the City of Sydney, Australia Centelonsolutions Full time

    Centelon is a modern, young technology company that carries an unflinching passion to help clients innovate, adapt and succeed. We are a business-technology products, solutions and services company. At Centelon, we harness the power of AI, digital and other emerging technologies to help our clients adapt to the evolving world. Centelon is a trusted partner...