Azure DevOps And Azure DataBricks

2 days ago


Sydney, New South Wales, Australia Resource Corner Full time $120,000 - $150,000 per year

Job description:
ADB + Azure DevOps

Primary Skills –

Azure DataBricks, Azure DevOps

Core Responsibilities

 
Databricks Development

  • Design and develop scalable data pipelines using Azure Databricks, PySpark, and SQL
  • Implement structured streaming, Delta Lake, and Unity Catalog.
  • Optimize Spark jobs and manage cluster performance.
  • Experience in a production support environment.
  • Expertise with Azure Databricks solutions.

 DevOps Integration

  • Build and maintain CI/CD pipelines using Azure DevOps, GitHub, Jenkins, and Terraform.
  • Automate deployment of notebooks, clusters, secrets, and data workflows.
  • Manage version control, branching strategies, and code reviews.
  • BODS ETL skills are a significant advantage
     as the scope of work includes supporting BODS ETL framework-based Oracle database reporting systems.

 
Cloud & Security

  • Work with Azure services: Data Factory, Blob Storage, Key Vault, Synapse, EventHub, and Power BI.
  • Implement RBAC/ABAC, encryption, and data masking for secure data handling.

 
Collaboration & Documentation

  • Collaborate with cross-functional teams for requirement gathering and solution design.
  • Document technical specifications, data dictionaries, and architecture blueprints.

Good to Have

  • Experience with MLflow, Power BI, and Databricks Dashboards.
  • Familiarity with Delta Live Tables.
  • Exposure to Agile, JIRA, and test management tools


  • Sydney, New South Wales, Australia ALOIS Solutions Full time $120,000 - $180,000 per year

    Role :ADB + Azure DevOpsLocation : SydneyJob Type : ContractJob description:Primary Skills – Azure DataBricks, Azure DevOpsCore ResponsibilitiesDatabricks DevelopmentDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured streaming, Delta Lake, and Unity Catalog.Optimize Spark jobs and manage cluster...

  • ADB + Azure DevOps

    6 days ago


    Sydney, New South Wales, Australia ITbility Full time $120,000 - $180,000 per year

    ADB + Azure DevOpsSydneyContract 6 + MonthsOur client in Sydney is looking forADB + Azure DevOpsthis is aContract 6 + Monthsrole. Please email me at for more information.Job description:Primary Skills –Azure DataBricks, Azure DevOpsDatabricks DevelopmentDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured...


  • Sydney, New South Wales, Australia Ampstek Full time $120,000 - $180,000 per year

    Must Have Skills: Azure SynapseNice to Have Skills: Elastics, DevOpsDetailed Job Description:The candidate must be proficient in Azure Synapse Analytics, Azure SQL DB with hands-on experience indesigning and implementing modern data warehousing solutions.Must be highly proficient in Azure Data Factory (ADF), with hands-on experience in building data...


  • Sydney, New South Wales, Australia Virtusa Full time $120,000 - $180,000 per year

    Job Summary:We are seeking a highly skilled and proactive Azure Data Platform Engineer to design, implement, and manage robust data solutions on Microsoft Azure. The ideal candidate will have deep expertise in Azure Synapse, Azure Databricks, Azure Fabric, and cloud infrastructure administration. This role involves maintaining server health, managing...

  • Azure Devops

    12 hours ago


    Sydney, New South Wales, Australia Peoplebank Australia NSW Full time $150,000 - $200,000 per year

    About the CompanyOur client is a large Australian organisation that is a leader in their field. The work culture is collaborative and supportive of each other. They look after their people and provide some of the best benefits, workspaces, and facilities in the industry. About the Role:The primary focus will be supporting a large-scale lift-and-shift...

  • Azure Data Engineer

    7 days ago


    Sydney, New South Wales, Australia AI Hustler Full time $120,000 - $180,000 per year

    We are urgently seeking a highly skilled and experiencedAzure Databricks Data Engineerto join our team in Sydney. This is a critical role for our data engineering function, focused on building robust, scalable, and efficient data solutions within the Azure cloud environment.If you have a passion for building complex data pipelines and thrive on solving...

  • Azure Synapse

    2 weeks ago


    Sydney, New South Wales, Australia BURGEON IT SERVICES Full time $120,000 - $180,000 per year

    Position: Azure Synapse ConsultantLocation: Sydney, NSWDuration: 6 monthsJob Details:Must Have Skills:Azure SynapseNice to Have Skills:Elastics, DevOpsDetailed Job Description:The candidate must be proficient inAzure Synapse Analytics,Azure SQL DBwith hands-on experience in designing and implementing modern data warehousing solutions.Must be highly...

  • Azure DevOps

    2 days ago


    Sydney, New South Wales, Australia Resource Corner Full time $60,000 - $120,000 per year

    Role - Azure DevOpsLocation - Sydney - NSWDevelop, Configure and Optimize CI/CD pipelines in Azure DevOps (YAML-Based), integrating automated build, test and deployment workflows. Skilled in Git Branching, Artifact management, environment, promotion and security scanning. Deliver automated deployment capability to support multi-environment releases for...


  • Sydney, New South Wales, Australia CareCone Group Full time $120,000 - $180,000 per year

    Role: Azure Databricks Platform AdministratorLocation: SydneyJob Description:Key Responsibilities:Workspace & Access ManagementCreate and manage Unity Catalog, workspaces, SCIM provisioning, and role-based access control (RBAC).Manage users, groups, service principals, and their access to notebooks, clusters, jobs, and data.Delegate workspace and account...


  • Sydney, New South Wales, Australia ALOIS Solutions Full time $80,000 - $120,000 per year

    Job Role – Azure DevOps EngineerJob Location – Sydney, AustraliaJob Type – ContractJob DescriptionKey Responsibilities:Design, implement, and manage CI/CD pipelines using Azure DevOps services to ensure seamless integration and deployment of Java-based applications.Automate build, test, and deployment processes using tools like Maven, PowerShell...