Azure Databricks Solutions Architect

7 days ago

Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $140,000
Job Role

A highly skilled Data Engineer is required to design and develop scalable data pipelines using Azure Databricks, PySpark, and SQL. This role will be part of a dynamic team that utilizes cutting-edge technology to drive business growth.

Main Responsibilities
  • Design and implement robust data pipelines with Azure Databricks, leveraging the power of big data analytics.
  • Collaborate with cross-functional teams to develop data-driven solutions using Delta Lake and Unity Catalog.
  • Optimize Spark job performance and manage cluster resources for maximum efficiency.
  • Maintain CI/CD pipelines using Azure DevOps, GitHub, Jenkins, and Terraform.
  • Implement automation scripts to deploy notebooks, clusters, secrets, and data workflows.
Key Skills
  • Experience in MLflow, Power BI, and Databricks Dashboards is highly desirable.
  • Familiarity with Delta Live Tables and Agile methodologies is essential.
  • Proficiency in test management tools and JIRA is required.

This position requires strong technical skills and excellent communication abilities. All candidates should have full working rights in Australia.

  • Azure Databricks Solutions Architect

    6 days ago

    Sydney, New South Wales, Australia Bebeedataengineer Full time

    Job RoleA highly skilled Data Engineer is required to design and develop scalable data pipelines using Azure Databricks, PySpark, and SQL. This role will be part of a dynamic team that utilizes cutting-edge technology to drive business growth.Main ResponsibilitiesDesign and implement robust data pipelines with Azure Databricks, leveraging the power of big...

  • Azure Devops+ Databricks

    1 week ago

    Sydney, New South Wales, Australia ALOIS Solutions Full time $104,000 - $130,878 per year

    Role :ADB + Azure DevOpsLocation : SydneyJob Type : ContractJob description:Primary Skills – Azure DataBricks, Azure DevOpsCore ResponsibilitiesDatabricks DevelopmentDesign and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured streaming, Delta Lake, and Unity Catalog.Optimize Spark jobs and manage cluster...

  • Resident Solutions Architect, ML

    1 week ago

    Sydney, New South Wales, Australia Databricks Full time

    Resident Solutions Architect, ML & GenAIJoin to apply for the Resident Solutions Architect, ML & GenAI role at DatabricksResident Solutions Architect, ML & GenAI1 week ago Be among the first 25 applicantsJoin to apply for the Resident Solutions Architect, ML & GenAI role at DatabricksCSQ426R250While candidates in Sydney are encouraged for this role,...

  • Azure Data Solutions Architect

    2 weeks ago

    Sydney, New South Wales, Australia INGRITY Full time $100,000 - $150,000 per year

    Are you an Azure Data Solutions Architect with expertise in Data Engineering and a knack for translating complex data needs into actionable solutions? Join our esteemed team at INGRITY, where your skills will play a crucial role in serving our clients effectively Location: Sydney. Employment Type: Full-Time. Eligibility: Open to candidates with full...

  • Sr. Resident Solutions Architect, Ml

    5 days ago

    Sydney, New South Wales, Australia Databricks Full time

    Sr.Resident Solutions Architect, ML & GenAIAs a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term engagements on their ML & AI challenges using the Databricks Data Intelligent platform.You will provide data science and cloud technology projects which require...

  • Sr. Resident Solutions Architect, Ml

    6 days ago

    Sydney, New South Wales, Australia Databricks Full time

    Sr. Resident Solutions Architect, ML & GenAI As a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term engagements on their ML & AI challenges using the Databricks Data Intelligent platform. You will provide data science and cloud technology projects which require...

  • Sr. Resident Solutions Architect, ML

    1 week ago

    Sydney, New South Wales, Australia Databricks Full time

    Sr. Resident Solutions Architect, ML & GenAIAs a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term engagements on their ML & AI challenges using the Databricks Data Intelligent platform. You will provide data science and cloud technology projects which require...

  • Sr. Resident Solutions Architect, ML

    1 week ago

    Sydney, New South Wales, Australia Databricks Full time

    Sr. Resident Solutions Architect, ML & GenAIAs a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term engagements on their ML & AI challenges using the Databricks Data Intelligent platform. You will provide data science and cloud technology projects which require...

  • Sr. Resident Solutions Architect, Ml

    5 days ago

    Sydney, New South Wales, Australia Databricks Full time

    Sr.Resident Solutions Architect, ML & GenAIAs a Machine Learning / GenAI Resident Solutions Architect (RSA) in our Professional Services team you will work with clients on short to medium term engagements on their ML & AI challenges using the Databricks Data Intelligent platform.You will provide data science and cloud technology projects which require...

  • Solutions Architect

    1 week ago

    Sydney, New South Wales, Australia Databricks Full time

    OverviewJoin to apply for the Solutions Architect role at Databricks.At Databricks, our core principles guide us to create a culture of proactiveness and a customer-centric mindset. We aim to inspire customers to make informed decisions that push their business forward by providing a user-friendly platform that turns insights into action and fosters...