Data Engineer Position in Brisbane for Databricks Upgrade

4 days ago


Brisbane, Queensland, Australia Randstad Full time
Upcoming Contract Opportunity

We are seeking a skilled Data Engineer to join our team in Brisbane for an initial 3-month contract. This role will play a pivotal part in various Databricks upgrades and assist the broader Data Engineering team across multiple data initiatives.

About the Role

This exciting opportunity involves:

  • Databricks Cluster Upgrade from version 9.1 to 14.3
  • Cost and Performance Improvement by implementing key Databricks functionalities, including Autoloader, transition from all-purpose clusters to job clusters, and workflow improvements
  • Completing planned data ingestions into the EDW
  • Decommissioning on-prem production EDW
  • Supporting ongoing project data ingestions
  • Providing BAU support for Data Engineering as needed
  • Supporting the progression of MS Fabric trial learnings

In order to succeed in this role, you will require:

  • Proven experience with Databricks upgrades and cluster management
  • Experience with some or all of the following Microsoft Azure components – Machine Learning, Logic Apps, Data Factory, Data Lake, Synapse, Cosmos DB, Databricks, dbt, and API Management
  • Expertise in optimising data processing with tools like Autoloader, job clusters, and workflows
  • Strong background in data ingestion into enterprise data warehouses (EDW)
  • Ability to manage priorities, support projects, and provide BAU assistance when needed

The salary range for this position is approximately $120,000 - $180,000 AUD per annum, based on your skills and experience. As a Randstad employee, you can expect competitive pay, a supportive work environment, and opportunities for career growth and development.


  • Data Engineer

    3 weeks ago


    Brisbane, Queensland, Australia Randstad Full time

    Randstad is currently working with a large organisation in Brisbane to find a Data Engineer to support their Data Engineering team. This role plays a pivotal part in Databricks upgrades and assisting with various Data initiatives.Key Responsibilities:Upgrading Databricks clusters from version 9.1 to 14.3Improving cost and performance by implementing key...

  • Data Engineer

    3 weeks ago


    Brisbane, Queensland, Australia Randstad Full time

    Randstad is currently working with a large organisation in Brisbane to find a Data Engineer to join their team for a contract. This role plays a pivotal part in Databricks upgrades and assisting the broader Data Engineering team across various Data initiatives.Key Responsibilities:Upgrading Databricks clusters from version 9.1 to 14.3Improving cost and...


  • Brisbane, Queensland, Australia Randstad Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team in Brisbane CBD. This 3-month contract will involve a variety of Databricks upgrades and data initiatives.Key ResponsibilitiesLead the upgrade from Databricks version 9.1 to 14.3, ensuring minimal disruption to ongoing projects.Implement cost and performance improvements by leveraging...

  • Data Engineer

    4 weeks ago


    Brisbane, Queensland, Australia Randstad Full time

    Data Engineer OpportunityRandstad is partnering with a leading organisation in Brisbane to find a skilled Data Engineer for a 3-month contract. This role plays a critical part in various Databricks upgrades and supports the broader Data Engineering team across multiple data initiatives.Key Responsibilities:Lead the upgrade of Databricks clusters from version...


  • Brisbane, Queensland, Australia Databricks Full time

    CSQ225R22This is a full-time position open to remote candidates in various locations.We are seeking an experienced Data Engineering Solutions Expert to join our Professional Services team. As a Big Data Resident Solutions Architect (RSA) in this role, you will work with clients on short to medium-term customer engagements on their big data challenges using...

  • Data Analyst

    2 weeks ago


    Brisbane, Queensland, Australia Randstad Full time

    Data Engineer Opportunity in Brisbane CBDRandstad Data is working with a large organisation to find a Data Engineer for an initial 3-month contract. This role plays a pivotal part in Databricks upgrades and Data Engineering initiatives.Key Responsibilities:Upgrading Databricks clusters from version 9.1 to 14.3Implementing cost and performance improvements...


  • Brisbane, Queensland, Australia Databricks Full time

    CSQ225R22We are open to candidates from various locations and welcome remote applications for this full-time position.As a Big Data Resident Solutions Architect (RSA) in our Professional Services team at Databricks, you will collaborate with clients on short to medium term customer engagements focused on big data challenges using the Databricks platform....


  • Brisbane, Queensland, Australia Databricks Full time

    CSQ225R22This is a full-time position that allows remote work. We encourage candidates from the listed location, but we are open to candidates from other locations as well.As a Big Data Resident Solutions Architect (RSA) in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges...


  • Brisbane, Queensland, Australia Databricks Full time

    About the Role:We are seeking a highly skilled Big Data Resident Solutions Architect to join our Professional Services team at Databricks. As a key member of our team, you will work closely with clients to deliver impactful customer technical projects, providing data engineering, data science, and cloud technology expertise.The Impact You Will Have:You will...


  • Brisbane, Queensland, Australia Firesoft People Full time

    Cloud Platform Upgrade ProjectFiresoft People is seeking a highly skilled Data Engineering professional to lead the upgrade of its cloud platform. This project will involve working with the latest technologies and tools to design, develop, and implement a scalable and secure data engineering solution.Key Responsibilities:Develop and implement cloud...

  • Data Engineer

    3 weeks ago


    Brisbane, Queensland, Australia Ampersand Ltd Full time

    Job Title: Data Engineer - Cloud Data PlatformAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Ampersand Ltd. As a Data Engineer, you will be responsible for building and maintaining data pipelines on our Cloud Data Platform. This is a permanent position based in Brisbane CBD, with a flexible work arrangement of 4 days in...


  • Brisbane, Queensland, Australia Talenza Full time

    Data Engineer Role at TalenzaTalenza's client is seeking a Brisbane-based Data Engineer with expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL. This key role involvesKey Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with cross-functional teams to integrate and automate data workflowsDevelop and enhance...

  • Senior Data Engineer

    3 weeks ago


    Brisbane, Queensland, Australia Talenza Full time

    Talenza is seeking a Brisbane-based Data Engineer to play a key role in BAU activities and new ongoing projects. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL.Key Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with cross-functional teams to integrate and automate data...


  • Brisbane, Queensland, Australia Talenza Full time

    Talenza's client is seeking a Brisbane-based Data Engineer to play a key role in BAU activities and new ongoing projects. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL.Key Responsibilities:Design, build, and maintain scalable data pipelines.Collaborate with cross-functional teams to integrate and automate...

  • Senior Data Engineer

    4 weeks ago


    Brisbane, Queensland, Australia Talenza Full time

    Talenza's client is seeking a Brisbane-based Data Engineer to play a key role in BAU activities and new ongoing projects. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL.Key Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with cross-functional teams to integrate and automate...

  • Senior Data Engineer

    3 weeks ago


    Brisbane, Queensland, Australia Talenza Full time

    Talenza's client is seeking a skilled Data Engineer to work in Brisbane. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL. This role will involve playing a key role in both BAU activities and new ongoing projects.Key Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with...


  • Brisbane, Queensland, Australia Talenza Full time

    Talenza is seeking a skilled Data Engineer to join their Brisbane team. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL. This role will involve playing a key part in both BAU activities and new ongoing projects (50/50).Key Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with...

  • Senior Data Engineer

    4 weeks ago


    Brisbane, Queensland, Australia Talenza Full time

    Talenza's Data Engineer OpportunityWe are seeking a skilled Data Engineer to join our Brisbane-based team. As a key member of our data team, you will play a crucial role in designing, building, and maintaining scalable data pipelines using Databricks, Azure Data Factory (ADF), Power BI, and SQL.Key Responsibilities:Data Pipeline Development: Design and build...


  • Brisbane, Queensland, Australia Firesoft People Full time

    Cloud Data Engineering OpportunityFiresoft People is seeking a skilled Data Engineer to join our team and contribute to the development of our cloud platform. This is an exciting opportunity to work with the latest technologies and be part of a dynamic team.Key ResponsibilitiesDesign, develop, and maintain data technologies such as Azure Data Factory, Azure...

  • Site Engineer

    1 month ago


    Brisbane, Queensland, Australia CGC Recruitment Full time

    Job Title: Site Engineer - Transport Infrastructure UpgradeCGC Recruitment is working with a National Tier 2 Contractor/Builder who primarily focuses on Building and Civil Infrastructure upgrades within the Rail corridor. They are growing rapidly in SE QLD and have recently secured x3 Infrastructure Upgrades for key Government clients.As a Site Engineer, you...