Big Data Lead Engineer

2 weeks ago

Sydney, New South Wales, Australia Zone IT Solutions Full time $180,000 - $250,000 per year

We are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologies

Technical and Team Leadership:

  • Provides technical direction and guidance to the engineering team.
  • Ensures adherence to engineering standards and best practices.
  • Participates in technical discussions and decision-making.
  • Identifies and resolves technical challenges and issues.
  • Conducts code reviews and provides feedback to other engineers.
  • Maintain high development standards and practices.
  • Facilitates team communication and collaboration.
  • Mentoring and guiding junior engineers.

Technical Skills

  • Proficient with Java, Scala/Spark, API and Streaming – Primary
  • Proficient with Pyspark, Python and SQL.
  • Experience in Azure cloud platform.
  • Expertise in various connectors and pipelines for batch and real-time data collection/delivery.
  • Performance tuning - table partitioning and indexing, process threading.

About Us

Zone IT Solutions is Australia based Recruitment Company. We specialize in Digital, ERP and larger IT Services. We offer flexible, efficient and collaborative solutions to any organization that requires IT, experts. Our agile, agnostic and flexible solutions will help you source the IT Expertise you need. Our delivery Offices are in Melbourne, Sydney and India. If you are looking for new opportunities; please share your profile at or contact us at

Also follow our LinkedIn page for new job opportunities and more.

Zone IT Solutions is an equal opportunity employer and our recruitment process focuses on essential skills and abilities. We welcome applicants from a diverse range of backgrounds, including Aboriginal and Torres Strait Islander peoples, people from culturally and linguistically diverse (CALD) backgrounds and people with disabilities.

  • Big Data Engineering Lead

    3 days ago

    Sydney, New South Wales, Australia Deloitte Full time $120,000 - $180,000 per year

    :Job Requisition ID:36903World class training and development.Truly flexible work.Hands-on mentoring on emerging technologies.What will your typical day look like?Deloitte AI & Data is changing the way that businesses leverage cloud-native technology to solve the toughest Data, Machine Learning and AI challenges faced by our customers Join us as we continue...

  • Staff / Lead Data Engineer (AWS, Big Data)

    3 days ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time $120,000 - $180,000 per year

    Staff / Lead Data Engineer (AWS, Big Data)You are determined to stay ahead of the latest Cloud, Big Data and Data warehouse technologies.We're one of the largest and most advanced Data Engineering teams in the country.Together we can build state-of-the-art data solutions that power seamless experiences for millions of customers.Do work that matters:As a...

  • Staff / Lead Data Engineer (AWS, Big Data)

    3 days ago

    Sydney, New South Wales, Australia Commonwealth Bank Full time $120,000 - $180,000 per year

    You are determined to stay ahead of the latest Cloud, Big Data and Data warehouse technologies.We're one of the largest and most advanced Data Engineering teams in the country.Together we can build state-of-the-art data solutions that power seamless experiences for millions of customers.Do work that matters:As a Staff Data engineer with expertise in software...

  • Big Data Developer

    7 days ago

    Sydney, New South Wales, Australia AI Hustler Full time $120,000 - $180,000 per year

    We are seeking a skilled and experiencedBig Data Engineerto join our growing data team. You will be instrumental in building, maintaining, and optimizing the data pipelines and infrastructure that power our analytics and machine learning initiatives. This is an exciting opportunity to work with complex datasets and cutting-edge technologies in a dynamic and...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Talenza Full time $200,000 - $250,000 per year

    Lead Data Engineer Sydney, Australia $230,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency. Key Responsibilities:Lead the development and...

  • Lead Data Engineer

    3 days ago

    Sydney, New South Wales, Australia tekFinder Full time $180,000 - $200,000 per year

    Hiring; Lead Data Engineer - ETL - AWS - SQL*You must live in Sydney for this role as 3 days per week in office are needed.We need a strong Data Tech Lead who can work on solution design from end to end and has a background in Spark SQL, AWS, ETL.This is not a hands off manager role - this is from someone who was once a strong data engineer with ETL/SQL and...

  • Lead Data Engineer – AWS

    1 week ago

    Sydney, New South Wales, Australia Bluefin Resources Pty Limited Full time $80,000 - $140,000 per year

    Join a high-performing Data team that's driving a large-scale transformation program within the banking and financial services industry. This is an excellent opportunity for an ambitious and technically strong Data Engineer to play a lead role in shaping a modern, cloud-based data platform. You'll be joining a collaborative, forward-thinking environment...

  • Big Data Developer

    2 weeks ago

    Sydney, New South Wales, Australia Cognizant Technology Solutions Full time US$75,000 - US$85,000 per year

    Position Summary:We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Lead Data Engineer

    5 days ago

    Sydney, New South Wales, Australia Macquarie Group Full time $120,000 - $200,000 per year

    Join our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem solving and technical data professional to contribute and grow rapidly within the...