Big Data Lead Engineer

1 week ago

Sydney, New South Wales, Australia CareCone Group Full time $150,000 - $200,000 per year

Role: Big Data Lead Engineer

Location: Sydney

Job Description:

Technical and Team Leadership:

  • Provides technical direction and guidance to the engineering team.
  • Ensures adherence to engineering standards and best practices.
  • Participates in technical discussions and decision-making.
  • Identifies and resolves technical challenges and issues.
  • Conducts code reviews and provides feedback to other engineers.
  • Maintain high development standards and practices.
  • Facilitates team communication and collaboration.
  • Mentoring and guiding junior engineers.

Technical Skills

  • Proficient with Java, Scala/Spark, API and Streaming – Primary
  • Proficient with Pyspark, Python and SQL.
  • Experience in Azure cloud platform.
  • Expertise in various connectors and pipelines for batch and real-time data collection/delivery.
  • Performance tuning - table partitioning and indexing, process threading.

Process:

  • Should have worked in Agile
  • Experience of working in JIRA and Confluence

Interested people can share their resume at or can reach me on

  • Big Data Lead Engineer

    6 days ago

    Sydney, New South Wales, Australia Zone IT Solutions Full time $180,000 - $250,000 per year

    We are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologiesTechnical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and...

  • Big data

    2 weeks ago

    Sydney, New South Wales, Australia BULLIT MANAGEMENT SERVICES LIMITED Full time $80,000 - $240,000 per year

    Job Description for Big Data Lead Engineer:Location : SydneyTechnical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and...

  • Big Data Lead Engineer

    1 week ago

    Sydney, New South Wales, Australia Tata Consultancy Services Full time $180,000 - $220,000 per year

    About the jobAbout TCS:Join Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us to combine a purpose-driven...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Lead Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Talenza Full time $200,000 - $250,000 per year

    Lead Data Engineer Sydney, Australia $230,000 (including Super) + Bonus About the Role: Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency. Key Responsibilities:Lead the development and...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Lead Data Engineer – AWS

    14 hours ago

    Sydney, New South Wales, Australia Bluefin Resources Pty Limited Full time $80,000 - $140,000 per year

    Join a high-performing Data team that's driving a large-scale transformation program within the banking and financial services industry. This is an excellent opportunity for an ambitious and technically strong Data Engineer to play a lead role in shaping a modern, cloud-based data platform. You'll be joining a collaborative, forward-thinking environment...

  • Big Data Developer

    6 days ago

    Sydney, New South Wales, Australia Cognizant Technology Solutions Full time US$75,000 - US$85,000 per year

    Position Summary:We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform...

  • Big Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Kaizen Global Technologies Full time $120,000 - $180,000 per year

    Job description :Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and provides feedback to other engineers.Maintain high development standards...

  • Data Engineer Consultant

    1 week ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...