Microsoft Azure Data Engineer

4 weeks ago

Sydney, Australia One51 Consulting Full time

We are looking for a Microsoft Azure Data Engineer who will be responsible for developing and maintaining the data architecture, data models and standards for various Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. In addition, develop and maintain the documentation of the data architecture, data flow, and data warehouse data models appropriate for both technical and business audiences.

Responsibilities:

  • Design and develop ETL pipelines in and out of a data warehouse using Azure Data Factory (ADF)
  • Ability to write SQL queries against Azure SQL Database / Synapse.
  • Provide production support for Azure SQL Database / Synapse issues such as data load problems, transformation, and translation problems.
  • Integration of on-premises infrastructure with cloud (Microsoft Azure) infrastructure.
  • Effectively translate requirements for Business Intelligence, Reporting and Analytics to database modelling and design.
  • Ability to understand data pipelines and modern ways of automating data pipelines using cloud-based and on-premises technologies.
  • Actively test and document implementations, so others can easily understand the requirements, implementation, and test conditions.
  • Partner with the Data Architects, Product Managers and Scrum Masters to deliver data integrations solutions required for various projects.
  • Ensure effective technical and project documentation across all phases of delivery.

Required:

  • Comprehensive, hands-on experience working as a Microsoft Azure Data Engineer. Ideally, a minimum of 3 years in Data Warehousing, ETL/ELT, BI, and Analytics projects.
  • Must have experience with at least one (1) end to end implementation of an Azure Cloud Data Warehouse and two (2) end to end data warehouse implementations.
  • Expertise in data modelling, ELT using ADF, implementing complex views, stored procedures and standard DWH and ETL/ELT concepts.
  • Extensive design and implementation experience in Azure cloud data platform and modern data warehousing. Including aspects such as Security, Azure Logging and Monitoring, Azure Databricks, Synapse, Azure Blob Storage, Azure Data Lake, Azure Data Factory, Azure SQL Database, Azure Analysis Services, Power BI
  • Deep understanding of relational and NoSQL data stores, methods, and approaches (star and snowflake, dimensional modelling).
  • Experience with data security and data access controls and design.
  • Proficiency in RDBMS, complex SQL queries, database performance tuning and troubleshooting.
  • Commercial experience with full-stack MS Power BI modelling (M code), Dax, data storytelling, report publishing, security, and knowledge of how people make decisions with data.
  • Provide resolution to an extensive range of complex data pipeline-related problems proactively and as issues surface.
  • Must have experience with Agile development methodologies.
  • Experience working directly with technical and business teams.
  • Strong written communication skills. Is effective and persuasive in both written and oral communication.

About One51

One51 Consulting is home to the collective knowledge and experience of diverse backgrounds but like-minded individuals. 

At the core of our culture, we value:

  • A passion for what we do: "We believe in the positive impact data and analytics can have in the data-driven organisation and individual".
  • Trust goes a long way: This starts with our employees and extends by nature to our clients. We are committed to building long-term partnerships based on trust, clear communication, and understanding.
  • Creativity and curiosity: Simple solutions to complex problems are possible when the solution design focuses on solving problems and is supported by the correct use of previous experiences and the appetite to keep learning every day.

At One51, you will have the opportunity to work with companies in different business sectors in a relaxed and supportive environment.

One51 uses a hybrid working arrangement – primarily working from home, with optional office days scheduled 1-2 days per week at our Sydney office.

  • Senior Azure Data Engineer

    4 weeks ago

    North Sydney, Australia NTT DATA Full time

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...

  • Graduate Software Engineer- Azure Trusted Platform

    3 days ago

    Sydney, Australia Microsoft Full time

    OverviewMicrosoft is built on trust, and Azure is dedicated to becoming the most trusted cloud service for its customers. As Azure expands its services, certifications, and regions for its global customers, there is a growing need for increased support to uphold customer promises. The Azure Core Trusted Platform team is committed to enabling product teams to...

  • Senior Software Engineer--Azure Core Storage

    7 days ago

    Sydney, Australia Microsoft Full time

    Overview We (Azure Core - Host Storage team) are responsible for delivering the Storage Virtualization platform to Azure Virtual Machines (VMs). Our stack handles trillions of internal orders (IOs) every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs,...

  • Software Engineer

    4 weeks ago

    Sydney, Australia Microsoft Full time

    OverviewThe Azure Core Storage team is responsible for delivering the Storage Virtualization platform to Azure Virtual Machines (VMs). Our stack handles trillions of Internal Orders (IOs) every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various caches,...

  • Senior Software Engineer--Azure Core Storage

    1 week ago

    Sydney, Australia Microsoft Full time

    OverviewWe (Azure Core - Host Storage team) are responsible for delivering the Storage Virtualization platform to Azure Virtual Machines (VMs). Our stack handles trillions of internal orders (IOs) every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various...

  • Software Engineer-Azure Core Storage

    1 week ago

    Sydney, Australia Microsoft Full time

    Overview We (Azure Core Storage team) are responsible for delivering Storage Virtualization platform to Azure VMs. Our stack handles trillions of IOs every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various caches, Throttles, QoS for Azure VMs,...

  • Azure Program Manager

    1 day ago

    Sydney, Australia Microsoft Full time

    OverviewAre you interested in working for one of the most exciting products in Microsoft, passionate about exceeding customer expectations and advancing Microsoft’s cloud first strategy? Are you passionate about cloud computing technology and driving growth in one of Microsoft’s core businesses? If so, then look no further than the Azure Customer...

  • Software Engineer

    4 weeks ago

    Sydney, Australia Microsoft Full time

    Overview The Azure Core Storage team is responsible for delivering the Storage Virtualization platform to Azure Virtual Machines (VMs). Our stack handles trillions of Internal Orders (IOs) every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various...

  • Software Engineer II- Azure Core Trusted Platform

    4 weeks ago

    Sydney, Australia Microsoft Full time

    OverviewMicrosoft is built on trust, and Azure is dedicated to becoming the most trusted cloud service for its customers. As Azure expands its services, certifications, and regions for its global customers, there is a growing need for increased support to uphold customer promises. The Azure Core Trusted Platform team is committed to enabling product teams to...

  • Software Engineer II- Azure Core Trusted Platform

    4 weeks ago

    Sydney, Australia Microsoft Full time

    Overview Microsoft is built on trust, and Azure is dedicated to becoming the most trusted cloud service for its customers. As Azure expands its services, certifications, and regions for its global customers, there is a growing need for increased support to uphold customer promises. The Azure Core Trusted Platform team is committed to enabling product...

  • Software Engineer II

    4 weeks ago

    Sydney, Australia Microsoft Full time

    Overview The Azure Core Storage team is responsible for delivering the Storage Virtualization platform to Azure Virtual Machines (VMs). Our stack handles trillions of IOs every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various caches, Throttles,...

  • Software Engineer II

    4 weeks ago

    Sydney, Australia Microsoft Full time

    OverviewThe Azure Core Storage team is responsible for delivering the Storage Virtualization platform to Azure  Virtual Machines (VMs). Our stack handles trillions of IOs every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various caches, Throttles,...

  • Software Engineer II--Azure Core Storage

    7 days ago

    Sydney, Australia Microsoft Full time

    Overview We (Azure Core Storage team) are responsible for delivering Storage Virtualization platform to Azure VMs. Our stack handles trillions of IOs every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various caches, Throttles, QoS for Azure VMs,...

  • Software Engineer, Azure Cosmic

    4 weeks ago

    Sydney, Australia Microsoft Full time

    Overview We are the Sky team.​ Our mission is to "Empower Microsoft Cloud teams and their customers to easily deliver high-quality services using standard cloud architecture and infrastructure.” The Azure Cosmic team designs, builds and operates a managed runtime environment based on a global scale Azure Kubernetes Service for the benefit of...

  • Senior Software Engineer

    4 weeks ago

    Sydney, Australia Microsoft Full time

    OverviewThe Azure Core Storage team is responsible for delivering the Storage Virtualization platform to Azure VMs. Our stack handles trillions of IOs every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various caches, Throttles, QoS for Azure VMs, various...

  • Azure Program Manager

    2 days ago

    Sydney, Australia Microsoft Full time

    Overview Are you interested in working for one of the most exciting products in Microsoft, passionate about exceeding customer expectations and advancing Microsoft’s cloud first strategy? Are you passionate about cloud computing technology and driving growth in one of Microsoft’s core businesses? If so, then look no further than the Azure Customer...

  • Senior Software Engineer

    4 weeks ago

    Sydney, Australia Microsoft Full time

    Overview The Azure Core Storage team is responsible for delivering the Storage Virtualization platform to Azure VMs. Our stack handles trillions of IOs every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various caches, Throttles, QoS for Azure VMs,...

  • Software Engineer II

    7 days ago

    Sydney, Australia Microsoft Full time

    Overview Newly released roles due to GROWTH! If you are a mid-level Software Engineer , you can benefit from the unique opportunities that Microsoft offers. You can boost your career, acquire deep technical skills, and discover various possibilities for your future growth. With Azure's continued expansion in containerized workloads and growing...

  • Senior Software Engineer- Azure Kubernetes Service

    4 weeks ago

    Sydney, Australia Microsoft Full time

    Overview Are you passionate about developing top-notch solutions for Azure Kubernetes Service customers? If so, we have an exciting opportunity for you! Azure Kubernetes Service is at the forefront of innovation, leveraging cutting-edge technologies to deliver exceptional solutions to Azure customers. As a Senior Software Engineer, on the Azure...

  • Software Engineer II--Azure Core Storage

    1 week ago

    Sydney, Australia Microsoft Full time

    OverviewWe (Azure Core Storage team) are responsible for delivering Storage Virtualization platform to Azure VMs. Our stack handles trillions of IOs every day from Azure VMs and runs in 100s of datacenters and 1000+ Clusters. We own the whole software stack on Azure Host responsible for handling VM IOs, various caches, Throttles, QoS for Azure VMs, various...