Data Engineer – Azure Data Factory and SQL Database Expertise

7 hours ago

Sydney, New South Wales, Australia Tech Aalto Full time $120,000 - $180,000 per year
Job Description: Data Engineer - Azure Data Factory and SQL Database Expertise

We are seeking a skilled Data Engineer with expertise in Microsoft Azure Data Factory (ADF) and SQL Database to join our dynamic team. The ideal candidate will have a strong background in Data Warehousing, ETL/ELT processes, and building robust data pipelines on Azure cloud platforms. This role is critical to ensuring efficient data modeling, integration, and transformation processes to support business operations and decision-making.

Key Responsibilities
  • Design, build, and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory (ADF)and other Azure cloud services.
  • Write and optimize T-SQL procedures for querying, data transformation, and validation in a Data Warehouse environment.
  • Develop and maintain metadata-driven data load frameworks for automated processing.
  • Implement dynamic data masking and ensure data security within Azure SQL Databases.
  • Perform data modeling to support Data Warehousing and Data Mart architecture.
  • Collaborate with stakeholders to gather requirements and provide technical solutions that meet business needs.
  • Ensure data quality checks and implement quality management processes.
  • Contribute to CI/CD pipeline implementation and management using Azure DevOps.
  • Maintain repository management using Git version control.
  • Engage in peer programming and contribute to agile project delivery.
  • Work with Azure Functions and Logic Apps to extend data integration capabilities.
Essential Criteria
  • 5+ years of experience as a Microsoft Azure Cloud ADF Data Engineer, including T-SQL in a Data Warehouse environment.
  • Solid understanding of Data Warehousing and Data Mart Architectures on Azure Cloud.
  • Proficiency in SQL for data querying, transformation, and validation.
  • Experience in building metadata-driven frameworks for automation on Azure.
  • Strong knowledge of data security practices and dynamic data masking in Azure SQL Database.
  • Hands-on experience with Azure Data Lake, Azure SQL Database, Azure Functions, and Logic Apps.
  • Minimum 3 years of experience in design and build using an agile delivery framework.
  • Familiarity with peer programming practices.
Desirable Criteria
  • Knowledge of SPSS programming language.
  • Experience in the Transport Safety industry (highly beneficial).
  • Proficiency with CI/CD pipelines in Azure DevOps and version control with Git.
  • Agile Scrum Master experience (optional but advantageous).
  • Strong communication skills for engaging business and technical stakeholders.
Qualifications and Skills
  • Expertise in data engineering technologies including data extraction, integration, and transformation.
  • In-depth knowledge of data modeling and working with various file types, databases, and APIs.
  • Hands-on experience with data quality management processes.

  • Data Engineer

    2 hours ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Senior Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia AI Hustler Full time $120,000 - $180,000 per year

    Are you a highly skilled data engineer with a passion for building robust, cloud-based data solutions? We are seeking a talented professional to join our team and play a pivotal role in a major data modernisation initiative within the financial sector. This is a chance to apply your expertise in Azure to create high-impact solutions that will shape our...

  • Senior Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Correlate Resources Full time $80,000 - $140,000 per year

    An exciting opportunity exists for an experienced Data Engineering Senior Specialist to join a high-performing data team working on large-scale enterprise initiatives within a modern Azure environment. This role offers the chance to design and optimise end-to-end data solutions that directly support strategic decision-making and business performance. Key...

  • Azure Synapse

    7 hours ago

    Sydney, New South Wales, Australia BURGEON IT SERVICES Full time $120,000 - $180,000 per year

    Position: Azure Synapse ConsultantLocation: Sydney, NSWDuration: 6 monthsJob Details:Must Have Skills:Azure SynapseNice to Have Skills:Elastics, DevOpsDetailed Job Description:The candidate must be proficient inAzure Synapse Analytics,Azure SQL DBwith hands-on experience in designing and implementing modern data warehousing solutions.Must be highly...

  • Azure Devops Consultant

    5 hours ago

    Sydney, New South Wales, Australia Ampstek Full time $120,000 - $180,000 per year

    Must Have Skills: Azure SynapseNice to Have Skills: Elastics, DevOpsDetailed Job Description:The candidate must be proficient in Azure Synapse Analytics, Azure SQL DB with hands-on experience indesigning and implementing modern data warehousing solutions.Must be highly proficient in Azure Data Factory (ADF), with hands-on experience in building data...

  • Azure Data Consultant

    1 week ago

    Sydney, New South Wales, Australia Arinco Full time $80,000 - $120,000 per year

    Our Co-Ops team is a cloud-managed services capability that provides operational support and enhancement services to our customers. We support Azure cloud customers, and we pride ourselves on being technical experts and solving problems at scale. We emphasise the importance of proactivity, innovation, automation and high quality when delivering outcomes for...

  • Azure Data Consultant

    6 hours ago

    Sydney, New South Wales, Australia Arinco Full time $80,000 - $120,000 per year

    Our Co-Ops team is a cloud-managed services capability that provides operational support and enhancement services to our customers. We support Azure cloud customers, and we pride ourselves on being technical experts and solving problems at scale. We emphasise the importance of proactivity, innovation, automation and high quality when delivering outcomes for...

  • Senior Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Alpha Plus Solution Full time $120,000 - $180,000 per year

    Location: Canberra/Brisbane/Sydney/Adelaide/Melbourne (hybrid working model)Security Clearance: Baseline (mandatory)Engagement Type: start from one year ContractAlpha Plus Solution is seeking an experienced Senior Data Engineer to support our client in delivering large-scale ICT transformation projects within the Indigo Program.The successful candidate will...

  • Azure Data Analyst

    1 week ago

    Sydney, New South Wales, Australia Virtusa Full time $120,000 - $180,000 per year

    As an Azure Databricks Architect, you will lead the design and implementation of scalable, secure, and high-performance data platforms using Azure Databricks. You will work closely with insurance clients to modernize their data ecosystems, enabling advanced analytics and AI-driven insights.Key responsibilities include architecting and implementing end-to-end...

  • Senior Data Architect

    4 days ago

    Sydney, New South Wales, Australia AI Talent Full time $180,000 - $220,000 per year

    We're partnering with a vital leader in theHealthcaresector, dedicated to modernising their data platform to support real-time clinical insights, operational efficiency, and advanced AI/ML capabilities. For the right candidate with the necessary skills and experience, we are pleased to offer482 visa sponsorship.This client requires aSenior Data Architectto...