Highly Skilled Data Engineer Leader

1 week ago

Perth, Western Australia beBeeDataEngineer Full time $150,000 - $180,000
Job Overview

We are seeking a seasoned data engineer to lead the design, development and optimization of large-scale data pipeline solutions on Databricks and related cloud platforms.

You will collaborate closely with data scientists, analysts and engineers to ensure our data infrastructure supports advanced analytics and business insights across industries.

Responsibilities

  • Collaborate with data scientists, analysts and other stakeholders to understand data requirements and deliver effective pipeline solutions.
  • Contribute to Data Architecture and Solution Design, helping to build proofs of concepts.
  • Design, develop and maintain robust ETL/ELT pipelines on Databricks, using AWS, Azure and GCP tools and services to ingest, process and transform large datasets.
  • Implement data validation, cleansing and governance procedures to guarantee data quality, integrity and security.
  • Continuously improve the scalability, efficiency and cost-effectiveness of data pipelines and identify opportunities to enhance performance, reliability and cost-efficiency across data systems.
  • Maintain clear documentation of data pipelines, data models and processes.

Qualifications

  • Proficiency in Python for data engineering (including PySpark and libraries like pandas/Polars) and SQL for data querying and transformation.
  • Solid understanding of data warehousing concepts and dimensional data modeling.
  • Hands-on experience with relational database systems and SQL (e.g. SQL Server, PostgreSQL) and familiarity with NoSQL databases (e.g. MongoDB, Cassandra).
  • Strong experience designing and implementing ETL/ELT processes and integrating data from multiple sources.

About the Role

This is an opportunity to work with a talented team of professionals who share your passion for data-driven innovation and excellence.

  • Highly Skilled Data Platforms Engineer

    1 week ago

    Perth, Western Australia beBeeData Full time $120,000 - $175,000

    Job Title: Specialist Data ProjectsBHP is generating large amounts of data from different sources and scaling value through delivery of emergent AI solutions. As a Specialist Data & AI Platforms Engineer, you will play a hands-on role supporting the design, implementation, and improvement of core Data & AI Platforms and Technologies.These platforms provide...

  • Highly Skilled Data Architect

    2 weeks ago

    Perth, Western Australia beBeeDataEngineer Full time $150,000 - $180,000

    Paxus is seeking a Senior Data Engineer to join our dynamic team on a contract basis.OverviewWe require a highly skilled and experienced professional to design, build, maintain, and optimize scalable data pipelines and infrastructure.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using modern ELT/ETL tools and technologies.Build...

  • Highly Skilled Data Specialist

    1 week ago

    Perth, Western Australia beBeeDataEngineer Full time $125,000 - $150,000

    Job Title:Data EngineerJob DescriptionThe primary function of this role is to drive the development of a robust data framework, ensuring sustained technical excellence through critical thinking and adherence to data engineering best practices.This position will involve contributing to various business services and applications, working closely with key...

  • Highly Skilled Database Professional

    1 week ago

    Perth, Western Australia beBeeData Full time $180,000 - $210,000

    Database Reliability Engineer IIIWe are seeking an experienced and skilled professional to join our Data Services team as a Database Reliability Engineer III. This role is responsible for maintaining a deep understanding of data components, including Cassandra, ElasticSearch/OpenSearch, Kafka, Zookeeper, MySQL and PostgreSQL.The successful candidate will...

  • Senior Systems Engineer

    2 weeks ago

    Perth, Western Australia VAST Data Full time US$150,000 - US$200,000 per year

    Systems EngineeringWest CoastFull-timeID: VDT26393DescriptionVAST Data is looking to hire a Senior Systems Engineer to focus on our CSP businessThis is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial...

  • Highly Skilled Data Systems Professional

    5 days ago

    Perth, Western Australia beBeeDataEngineer Full time $120,000 - $180,000

    Job DescriptionAs a Senior/Staff Data Engineer, you will operate at massive scale across multiple data centers, handling millions of writes per second and managing tens of petabytes of data. You will tackle complex challenges in real-time data ingestion, replication, enrichment, storage, and analytics.You will enhance the monitorability, scalability,...

  • Highly Skilled Engineer Wanted

    5 days ago

    Perth, Western Australia beBeeCareer Full time $100,000 - $150,000

    Job Title:Control Systems SpecialistJob Overview:We are seeking a highly skilled Control Systems Specialist to join our team. The ideal candidate will have extensive experience in designing, developing, and implementing high-quality engineering solutions.This is an excellent opportunity for professionals looking to take their career to the next level by...

  • Highly Skilled Engineering Professional Wanted

    4 days ago

    Perth, Western Australia beBeeEngineering Full time $90,000 - $120,000

    Job TitleA highly skilled and experienced Engineering Officer / Purchasing Officer is required for our Hazelmere workshop based in Perth.

  • Highly Skilled Azure Data Professional

    6 days ago

    Perth, Western Australia beBeeDatabase Full time $120,000 - $160,000

    Job OverviewThis is a highly skilled professional role supporting a state-of-the-art Data Lakehouse platform built on Azure Data Fabric and Informatica.About the PositionWe are seeking an experienced expert to design, deploy, and maintain Azure SQL and Cosmos databases, build and manage Informatica data pipelines, and enable new Data Analytics and AI...

  • Highly Skilled Software Engineer Wanted

    1 week ago

    Perth, Western Australia beBeeDeveloper Full time $75,000 - $80,000

    Software Development PositionWe are seeking a highly skilled software developer to join our team. As a senior software engineer, you will be responsible for developing and maintaining software applications that meet business needs.