
Azure Devops+ Databricks
7 days ago
Role :
ADB + Azure DevOps
Location : Sydney
Job Type : Contract
Job description:
Primary Skills – Azure DataBricks, Azure DevOps
Core Responsibilities
Databricks Development
- Design and develop scalable data pipelines using Azure Databricks, PySpark, and SQL
- Implement structured streaming, Delta Lake, and Unity Catalog.
- Optimize Spark jobs and manage cluster performance.
- Experience in a production support environment.
- Expertise with Azure Databricks solutions.
DevOps Integration
- Build and maintain CI/CD pipelines using Azure DevOps, GitHub, Jenkins, and Terraform.
- Automate deployment of notebooks, clusters, secrets, and data workflows.
- Manage version control, branching strategies, and code reviews.
- BODS ETL skills are a significant advantage
as the scope of work includes supporting BODS ETL framework-based Oracle database reporting systems.
Cloud & Security
- Work with Azure services: Data Factory, Blob Storage, Key Vault, Synapse, EventHub, and Power BI.
- Implement RBAC/ABAC, encryption, and data masking for secure data handling.
Collaboration & Documentation
- Collaborate with cross-functional teams for requirement gathering and solution design.
- Document technical specifications, data dictionaries, and architecture blueprints.
Good to Have
- Experience with MLflow, Power BI, and Databricks Dashboards.
- Familiarity with Delta Live Tables.
- Exposure to Agile, JIRA, and test management tools
-
Azure DevOps And Azure DataBricks
4 days ago
Sydney, New South Wales, Australia Resource Corner Full time $104,000 - $130,878 per yearJob description:ADB + Azure DevOpsPrimary Skills –Azure DataBricks, Azure DevOpsCore Responsibilities Databricks DevelopmentDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured streaming, Delta Lake, and Unity Catalog.Optimize Spark jobs and manage cluster performance.Experience in a production support...
-
ADB + Azure DevOps
7 days ago
Sydney, New South Wales, Australia ITbility Full time $104,000 - $130,878 per yearADB + Azure DevOpsSydneyContract 6 + MonthsOur client in Sydney is looking forADB + Azure DevOpsthis is aContract 6 + Monthsrole. Please email me at for more information.Job description:Primary Skills –Azure DataBricks, Azure DevOpsDatabricks DevelopmentDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured...
-
ADB + Azure DevOps
3 days ago
Sydney, New South Wales, Australia Ayan Infotech Full timeOverviewAyan Infotech are looking for an ADB + Azure DevOps Consultant for a long term contract job opportunity in Sydney. All applicants must have full unrestricted work rights in Australia.Title: ADB + Azure DevOpsLocation: SydneyType: Contract (6 months +)Nature of work: HybridCore RequirementsRequired Skills and ExperienceDatabricks Development- Design...
-
ADB + Azure DevOps
3 days ago
Sydney, New South Wales, Australia Ayan Infotech Full timeOverviewAyan Infotech are looking for an ADB + Azure DevOps Consultant for a long term contract job opportunity in Sydney. All applicants must have full unrestricted work rights in Australia.Title: ADB + Azure DevOpsLocation: SydneyType: Contract (6 months +)Nature of work: HybridCore RequirementsRequired Skills and ExperienceDatabricks DevelopmentDesign and...
-
Azure Databricks Solutions Architect
3 days ago
Sydney, New South Wales, Australia Bebeedataengineer Full timeJob RoleA highly skilled Data Engineer is required to design and develop scalable data pipelines using Azure Databricks, PySpark, and SQL. This role will be part of a dynamic team that utilizes cutting-edge technology to drive business growth.Main ResponsibilitiesDesign and implement robust data pipelines with Azure Databricks, leveraging the power of big...
-
Azure Databricks Solutions Architect
4 days ago
Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $140,000Job RoleA highly skilled Data Engineer is required to design and develop scalable data pipelines using Azure Databricks, PySpark, and SQL. This role will be part of a dynamic team that utilizes cutting-edge technology to drive business growth.Main ResponsibilitiesDesign and implement robust data pipelines with Azure Databricks, leveraging the power of big...
-
ADB + Azure DevOps
5 days ago
Sydney, New South Wales, Australia ITbility Full timeOverviewOur client in Sydney is looking for ADB + Azure DevOps on a Contract 6 + Months basis. For more information, please email supriya.thorat@itbility.com.au.ResponsibilitiesDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured streaming, Delta Lake, and Unity CatalogOptimize Spark jobs and manage cluster...
-
ADB + Azure DevOps
5 days ago
Sydney, New South Wales, Australia ITbility Full timeOverview Our client in Sydney is looking for ADB + Azure DevOps on a Contract 6 + Months basis. For more information, please email supriya.thorat@itbility.com.au. ResponsibilitiesDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQL Implement structured streaming, Delta Lake, and Unity Catalog Optimize Spark jobs and...
-
Azure Devops
2 weeks ago
Sydney, New South Wales, Australia Peoplebank Full time $90,000 - $120,000 per yearAbout the CompanyOur client is a large Australian organisation that is a leader in their field. The work culture is collaborative and supportive of each other. They look after their people and provide some of the best benefits, workspaces, and facilities in the industry.About the Role:The primary focus will be supporting a large-scale lift-and-shift...
-
Azure Devops
1 week ago
Sydney, New South Wales, Australia Peoplebank Australia NSW Full time $90,000 - $120,000 per yearAbout the CompanyOur client is a large Australian organisation that is a leader in their field. The work culture is collaborative and supportive of each other. They look after their people and provide some of the best benefits, workspaces, and facilities in the industry. About the Role:The primary focus will be supporting a large-scale lift-and-shift...