Lead Data Engineer

2 weeks ago

Melbourne, Victoria, Australia ClearCompany Full time

Lead Data Engineer required to support the development of an Azure Databricks platform for a leading financial services business.

Responsibilities:

  • design and development of pipelines using Databricks and Lakehouse
  • optimisation and maintenance of data workflows, ensuring quality and integrity
  • performance tuning and monitoring
  • Notebook development using Python and/or Pyspark
  • implementation of best practices for data engineering, including governance and security
  • mentoring and coaching of junior Data Engineers
Requirements:
  • extensive experience building data pipelines in a Databricks Lakehouse environment
  • well-versed with Spark and other big data technologies
  • excellent coding skills using SQL and Python
  • strong background developing solutions in an Azure Cloud environment, including strong ADF development skills
Click on the 'Apply' button to submit your CV.
#J-18808-Ljbffr

  • Lead Data Engineer

    3 weeks ago

    Melbourne, Victoria, Australia OnePass Full time

    Why OneDigital?Are you interested in joining the team at Wesfarmers OneDigital?Good call. We're an exciting digital enterprise with big ideas, supporting some of Australia's most trusted and iconic brands.We're well on our way towards bringing the best of digital and data possibilities together to create more personalised shopping experiences for customers...

  • Lead Data Engineer

    4 days ago

    Melbourne, Victoria, Australia Buscojobs Full time

    Application closing date: Tuesday, 15 July 2025 • 11:59pm, Canberra timeEstimated start date: Tuesday, 12 August 2025Location of work: VICWorking arrangements: Hybrid working arrangements (i.e. a combination of onsite attendance at an AEC office and remote working) will be considered at the discretion of the Hiring Manager with a typical 3 days in the...

  • Data Engineering Lead

    1 day ago

    Melbourne, Victoria, Australia beBeeDataEngineering Full time $100,000 - $140,000

    Senior Consultant, Data EngineeringWe are seeking a seasoned Senior Consultant to join our team as a data engineering expert.Key Responsibilities:The successful candidate will have experience in designing and implementing data pipelines, communicating with clients, and taking on responsibility for deliveries. They will also be able to help more junior...

  • Full Stack Engineer

    3 weeks ago

    Melbourne, Victoria, Australia Champion Data Full time

    Get AI-powered advice on this job and more exclusive features.At Champion Data, our dedicated team are united by sport and driven by data. We strive to revolutionise and transform sport data globally by leveraging our cutting-edge technology and expert team, ensuring we deliver the best possible outcomes for our partners and clients.About the jobChampion...

  • Full Stack Engineer

    2 weeks ago

    Melbourne, Victoria, Australia Champion Data Full time

    Get AI-powered advice on this job and more exclusive features.At Champion Data, our dedicated team are united by sport and driven by data. We strive to revolutionise and transform sport data globally by leveraging our cutting-edge technology and expert team, ensuring we deliver the best possible outcomes for our partners and clients.About the jobChampion...

  • Lead Data Engineer

    3 days ago

    Melbourne, Victoria, Australia Infosys Singapore & Australia Full time

    Infosys Consulting is the worldwide management and IT consultancy unit of the Infosys Group (NYSE: INFY), a global advisor to leading companies for strategy, process engineering, and technology-enabled transformation programs.We partner with clients to design and implement customized solutions to address their complex business challenges, and to help them in...

  • Lead Data engineer

    3 weeks ago

    Melbourne, Victoria, Australia Infosys Singapore & Australia Full time

    Infosys Consulting is the worldwide management and IT consultancy unit of the Infosys Group (NYSE: INFY), a global advisor to leading companies for strategy, process engineering, and technology-enabled transformation programs.We partner with clients to design and implement customized solutions to address their complex business challenges, and to help them in...

  • Lead Data engineer

    2 days ago

    Melbourne, Victoria, Australia Infosys Singapore & Australia Full time $90,000 - $120,000 per year

    Infosys Consulting is the worldwide management and IT consultancy unit of the Infosys Group (NYSE: INFY), a global advisor to leading companies for strategy, process engineering, and technology-enabled transformation programs. We partner with clients to design and implement customized solutions to address their complex business challenges, and to help them...

  • MS Engineer

    2 weeks ago

    Melbourne, Victoria, Australia NTT DATA, Inc. Full time

    Join to apply for the MS Engineer (L1): Network role at NTT DATA, Inc.Join to apply for the MS Engineer (L1): Network role at NTT DATA, Inc.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society....

  • MS Engineer

    2 weeks ago

    Melbourne, Victoria, Australia NTT DATA, Inc. Full time

    Join to apply for the MS Engineer (L1): Network role at NTT DATA, Inc.Join to apply for the MS Engineer (L1): Network role at NTT DATA, Inc.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society....