Azure Data Engineer

1 week ago

Sydney, New South Wales, Australia AI Hustler Full time $104,000 - $130,878 per year

We are urgently seeking a highly skilled and experienced
Azure Databricks Data Engineer
to join our team in Sydney. This is a critical role for our data engineering function, focused on building robust, scalable, and efficient data solutions within the Azure cloud environment.

If you have a passion for building complex data pipelines and thrive on solving large-scale data challenges, we want to hear from you. This contract offers the opportunity to work on impactful projects with a high chance of long-term engagement.

Key Responsibilities:

  • Design & Development:
    Architect, develop, and optimize data pipelines and ETL/ELT processes using modern tools like
    Azure Data Factory
    ,
    Azure Synapse Analytics
    , and primarily
    Azure Databricks
    .
  • Data Transformation:
    Work with large volumes of structured and unstructured data to build and maintain data lakes, data warehouses, and real-time streaming solutions.
  • Performance & Optimization:
    Utilize
    Apache Spark
    within Databricks to handle large-scale data processing and optimize the performance and cost of data workflows in Azure.
  • Collaboration:
    Partner closely with data scientists, business analysts, and key stakeholders to understand data requirements and deliver solutions that meet business objectives.
  • Data Governance & Security:
    Implement and enforce best practices in data quality, security, and governance using tools such as
    Azure Purview
    ,
    Azure Key Vault
    , and Role-Based Access Control (RBAC).

Required Skills & Qualifications:

  • Experience:
    A minimum of
    4 years
    of hands-on experience as a Data Engineer or in a similar role.
  • Databricks Expertise:
    Strong, demonstrable experience with
    Azure Databricks
    and deep knowledge of
    Apache Spark
    .
  • Technical Proficiency:
    Expert-level skills in
    Python
    ,
    PySpark
    , and
    SQL
    are essential.
  • Azure Stack:
    In-depth knowledge of core Azure data services, including
    Azure Data Lake Storage
    ,
    Azure Blob Storage
    , and
    Azure Data Factory
    .
  • Data Architecture:
    Solid understanding of
    Delta Lake architecture
    and modern
    data lakehouse
    concepts.
  • DevOps:
    Familiarity with CI/CD pipelines and DevOps practices within the Azure ecosystem (e.g., using
    Azure DevOps
    ).
  • Foundational Knowledge:
    A strong grasp of data modeling techniques, performance tuning, and cloud security principles.

If you are an experienced data engineer looking for a challenging and impactful role, we'd love to hear from you.

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Ashdown People Full time $150,000 - $200,000 per year

    Are you ready to take on a role where your work directly shapes how large-scale platforms operate, process massive datasets, and deliver actionable insights? We are seeking an experienced Senior Data Engineer to join a high-performing team working with some of the most advanced distributed systems in the industry. In this role, you'll be building and...

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Robert Half Full time $90,000 - $120,000 per year

    Job Description:Key Responsibilities: Design, develop, and monitor data ingestion pipelines from various sources. Continuously improve and optimize existing data pipelines for performance and scalability. Model data from API outputs into a relational format. Develop CI/CD pipelines using GitHub Actions. Provide support to ensure secure access to data for...

  • Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Robert Half Full time $90,000 - $120,000 per year

    This insurance firm is actively seeking a highly skilled Data Engineer to join their Data and Analytics team. The ideal candidate is adept at creating and optimizing data systems and has a strong background in data pipeline development and data wrangling. If you thrive in a collaborative environment and have a passion for data, this is the perfect...

  • Senior Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia INGRITY Full time $120,000 - $140,000 per year

    Are you a well-rounded Senior Azure Data Engineer with a passion for architecting scalable, efficient, and secure data solutions? Join our esteemed team at INGRITY, where your skills will play a crucial role in serving our clients effectively. Location: Sydney. Employment Type: Full-Time. Eligibility: Open to candidates with full working...

  • Microsoft Azure Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Buscojobs Full time

    We are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining data architecture, models, and standards for Data Integration & Data Warehouse projects in Azure.Ensure new features and subject areas are integrated with existing structures to provide a consistent view.Develop and maintain documentation of data architecture, data...

  • Microsoft Azure Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Buscojobs Full time

    We are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining data architecture, models, and standards for Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are integrated with existing structures to provide a consistent view. Develop and maintain documentation of data architecture,...