Data Engineer Position in Brisbane for Databricks Upgrade
4 days ago
We are seeking a skilled Data Engineer to join our team in Brisbane for an initial 3-month contract. This role will play a pivotal part in various Databricks upgrades and assist the broader Data Engineering team across multiple data initiatives.
About the RoleThis exciting opportunity involves:
- Databricks Cluster Upgrade from version 9.1 to 14.3
- Cost and Performance Improvement by implementing key Databricks functionalities, including Autoloader, transition from all-purpose clusters to job clusters, and workflow improvements
- Completing planned data ingestions into the EDW
- Decommissioning on-prem production EDW
- Supporting ongoing project data ingestions
- Providing BAU support for Data Engineering as needed
- Supporting the progression of MS Fabric trial learnings
In order to succeed in this role, you will require:
- Proven experience with Databricks upgrades and cluster management
- Experience with some or all of the following Microsoft Azure components – Machine Learning, Logic Apps, Data Factory, Data Lake, Synapse, Cosmos DB, Databricks, dbt, and API Management
- Expertise in optimising data processing with tools like Autoloader, job clusters, and workflows
- Strong background in data ingestion into enterprise data warehouses (EDW)
- Ability to manage priorities, support projects, and provide BAU assistance when needed
The salary range for this position is approximately $120,000 - $180,000 AUD per annum, based on your skills and experience. As a Randstad employee, you can expect competitive pay, a supportive work environment, and opportunities for career growth and development.
-
Data Engineer
3 weeks ago
Brisbane, Queensland, Australia Randstad Full timeRandstad is currently working with a large organisation in Brisbane to find a Data Engineer to support their Data Engineering team. This role plays a pivotal part in Databricks upgrades and assisting with various Data initiatives.Key Responsibilities:Upgrading Databricks clusters from version 9.1 to 14.3Improving cost and performance by implementing key...
-
Data Engineer
3 weeks ago
Brisbane, Queensland, Australia Randstad Full timeRandstad is currently working with a large organisation in Brisbane to find a Data Engineer to join their team for a contract. This role plays a pivotal part in Databricks upgrades and assisting the broader Data Engineering team across various Data initiatives.Key Responsibilities:Upgrading Databricks clusters from version 9.1 to 14.3Improving cost and...
-
Data Engineer: Databricks Expert
2 days ago
Brisbane, Queensland, Australia Randstad Full timeAbout the RoleWe are seeking an experienced Data Engineer to join our team in Brisbane CBD. This 3-month contract will involve a variety of Databricks upgrades and data initiatives.Key ResponsibilitiesLead the upgrade from Databricks version 9.1 to 14.3, ensuring minimal disruption to ongoing projects.Implement cost and performance improvements by leveraging...
-
Data Engineer
4 weeks ago
Brisbane, Queensland, Australia Randstad Full timeData Engineer OpportunityRandstad is partnering with a leading organisation in Brisbane to find a skilled Data Engineer for a 3-month contract. This role plays a critical part in various Databricks upgrades and supports the broader Data Engineering team across multiple data initiatives.Key Responsibilities:Lead the upgrade of Databricks clusters from version...
-
Data Engineering Solutions Expert
4 days ago
Brisbane, Queensland, Australia Databricks Full timeCSQ225R22This is a full-time position open to remote candidates in various locations.We are seeking an experienced Data Engineering Solutions Expert to join our Professional Services team. As a Big Data Resident Solutions Architect (RSA) in this role, you will work with clients on short to medium-term customer engagements on their big data challenges using...
-
Data Analyst
2 weeks ago
Brisbane, Queensland, Australia Randstad Full timeData Engineer Opportunity in Brisbane CBDRandstad Data is working with a large organisation to find a Data Engineer for an initial 3-month contract. This role plays a pivotal part in Databricks upgrades and Data Engineering initiatives.Key Responsibilities:Upgrading Databricks clusters from version 9.1 to 14.3Implementing cost and performance improvements...
-
Big Data Technical Architect
2 weeks ago
Brisbane, Queensland, Australia Databricks Full timeCSQ225R22We are open to candidates from various locations and welcome remote applications for this full-time position.As a Big Data Resident Solutions Architect (RSA) in our Professional Services team at Databricks, you will collaborate with clients on short to medium term customer engagements focused on big data challenges using the Databricks platform....
-
Big Data Solutions Architect
3 weeks ago
Brisbane, Queensland, Australia Databricks Full timeCSQ225R22This is a full-time position that allows remote work. We encourage candidates from the listed location, but we are open to candidates from other locations as well.As a Big Data Resident Solutions Architect (RSA) in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges...
-
Big Data Solutions Architect
1 month ago
Brisbane, Queensland, Australia Databricks Full timeAbout the Role:We are seeking a highly skilled Big Data Resident Solutions Architect to join our Professional Services team at Databricks. As a key member of our team, you will work closely with clients to deliver impactful customer technical projects, providing data engineering, data science, and cloud technology expertise.The Impact You Will Have:You will...
-
Data Engineering Specialist
4 weeks ago
Brisbane, Queensland, Australia Firesoft People Full timeCloud Platform Upgrade ProjectFiresoft People is seeking a highly skilled Data Engineering professional to lead the upgrade of its cloud platform. This project will involve working with the latest technologies and tools to design, develop, and implement a scalable and secure data engineering solution.Key Responsibilities:Develop and implement cloud...
-
Data Engineer
3 weeks ago
Brisbane, Queensland, Australia Ampersand Ltd Full timeJob Title: Data Engineer - Cloud Data PlatformAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Ampersand Ltd. As a Data Engineer, you will be responsible for building and maintaining data pipelines on our Cloud Data Platform. This is a permanent position based in Brisbane CBD, with a flexible work arrangement of 4 days in...
-
Senior Data Engineer
7 days ago
Brisbane, Queensland, Australia Talenza Full timeData Engineer Role at TalenzaTalenza's client is seeking a Brisbane-based Data Engineer with expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL. This key role involvesKey Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with cross-functional teams to integrate and automate data workflowsDevelop and enhance...
-
Senior Data Engineer
3 weeks ago
Brisbane, Queensland, Australia Talenza Full timeTalenza is seeking a Brisbane-based Data Engineer to play a key role in BAU activities and new ongoing projects. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL.Key Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with cross-functional teams to integrate and automate data...
-
Data Engineering Specialist
3 weeks ago
Brisbane, Queensland, Australia Talenza Full timeTalenza's client is seeking a Brisbane-based Data Engineer to play a key role in BAU activities and new ongoing projects. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL.Key Responsibilities:Design, build, and maintain scalable data pipelines.Collaborate with cross-functional teams to integrate and automate...
-
Senior Data Engineer
4 weeks ago
Brisbane, Queensland, Australia Talenza Full timeTalenza's client is seeking a Brisbane-based Data Engineer to play a key role in BAU activities and new ongoing projects. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL.Key Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with cross-functional teams to integrate and automate...
-
Senior Data Engineer
3 weeks ago
Brisbane, Queensland, Australia Talenza Full timeTalenza's client is seeking a skilled Data Engineer to work in Brisbane. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL. This role will involve playing a key role in both BAU activities and new ongoing projects.Key Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with...
-
Data Engineering Expert
3 weeks ago
Brisbane, Queensland, Australia Talenza Full timeTalenza is seeking a skilled Data Engineer to join their Brisbane team. The ideal candidate will have expertise in Databricks, Azure Data Factory (ADF), Power BI, and SQL. This role will involve playing a key part in both BAU activities and new ongoing projects (50/50).Key Responsibilities:Design, build, and maintain scalable data pipelinesCollaborate with...
-
Senior Data Engineer
4 weeks ago
Brisbane, Queensland, Australia Talenza Full timeTalenza's Data Engineer OpportunityWe are seeking a skilled Data Engineer to join our Brisbane-based team. As a key member of our data team, you will play a crucial role in designing, building, and maintaining scalable data pipelines using Databricks, Azure Data Factory (ADF), Power BI, and SQL.Key Responsibilities:Data Pipeline Development: Design and build...
-
Data Engineering Specialist
1 month ago
Brisbane, Queensland, Australia Firesoft People Full timeCloud Data Engineering OpportunityFiresoft People is seeking a skilled Data Engineer to join our team and contribute to the development of our cloud platform. This is an exciting opportunity to work with the latest technologies and be part of a dynamic team.Key ResponsibilitiesDesign, develop, and maintain data technologies such as Azure Data Factory, Azure...
-
Site Engineer
1 month ago
Brisbane, Queensland, Australia CGC Recruitment Full timeJob Title: Site Engineer - Transport Infrastructure UpgradeCGC Recruitment is working with a National Tier 2 Contractor/Builder who primarily focuses on Building and Civil Infrastructure upgrades within the Rail corridor. They are growing rapidly in SE QLD and have recently secured x3 Infrastructure Upgrades for key Government clients.As a Site Engineer, you...