Big Data Lead Engineer

3 weeks ago

Sydney, New South Wales, Australia Tata Consultancy Services Full time
Overview

Job Title: Big Data Lead Engineer

About the job

Join Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us to combine a purpose-driven worldview with digital innovation, collaborating with customers, communities and governments to lead and shape innovative solutions for a sustainable future.

Corporate sustainability is embedded in our triple-bottom-line, focusing on people, the planet, and our purpose. Our offices are designed with eco-friendly features that significantly reduce our carbon footprint and enhance energy efficiency. When you become part of the TCS family, you will play an essential role dedicated to innovation, excellence, and crafting a brighter, greener future together.

Responsibilities
  • Provides technical direction and guidance to the engineering team.
  • Ensures adherence to engineering standards and best practices.
  • Participates in technical discussions and decision-making.
  • Identifies and resolves technical challenges and issues.
  • Conducts code reviews and provides feedback to other engineers.
  • Maintain high development standards and practices.
  • Facilitates team communication and collaboration.
  • Mentoring and guiding junior engineers.
Technical Skills
  • Proficient with Java, Scala/Spark, API and Streaming – Primary
  • Proficient with PySpark, Python and SQL
  • Experience in Azure cloud platform
  • Expertise in various connectors and pipelines for batch and real-time data collection/delivery
  • Performance tuning - table partitioning and indexing, process threading
Process
  • Should have worked in Agile
  • Experience of working in JIRA and Confluence
Job details
  • Seniority level: Mid-Senior level
  • Employment type: Full-time
  • Job function: Information Technology
  • Industries: IT Services and IT Consulting

#J-18808-Ljbffr

  • Big Data Engineering Lead

    6 days ago

    Sydney, New South Wales, Australia Deloitte Full time $120,000 - $180,000 per year

    :Job Requisition ID:36903World class training and development.Truly flexible work.Hands-on mentoring on emerging technologies.What will your typical day look like?Deloitte AI & Data is changing the way that businesses leverage cloud-native technology to solve the toughest Data, Machine Learning and AI challenges faced by our customers Join us as we continue...

  • Big Data Engineer

    1 week ago

    Sydney, New South Wales, Australia beBeeBigDataEngineer Full time $75,000 - $85,000

    Seeking a skilled Big Data Engineer with expertise in designing, developing and maintaining scalable big data solutions.Job DescriptionWe are looking for an experienced professional to lead the development of robust and efficient big data systems using modern tools and technologies.Key Responsibilities:Design and implement large-scale data processing...

  • Big Data Lead Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Tata Consultancy Services Full time

    OverviewJob Title:Big Data Lead EngineerAbout the jobJoin Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $180,000 - $230,000

    As a data engineer in our data platform team, you will have the opportunity to build, optimize and grow one of the world's largest data platforms that directly supports millions of users.You'll gain hands-on experience on all kinds of systems in the data platform ecosystem.Job Description:We are seeking an experienced data engineer who can design, implement...

  • Big Data Lead Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Tata Consultancy Services Full time

    OverviewJob Title: Big Data Lead EngineerAbout the jobJoin Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us...

  • Big Data Lead Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Zone IT Solutions Full time

    OverviewWe are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologies.ResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and...

  • Big Data Lead Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Zone IT Solutions Full time

    OverviewWe are looking for a Big Data Lead Engineer based in Sydney, proficient in Java, Scala/Spark, API development, and real-time streaming technologies.ResponsibilitiesProvides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and...

  • Big Data Engineer Position

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time $150,000 - $200,000

    Job Opportunity for Experienced Big Data EngineerWe are seeking a highly skilled and experienced Big Data engineer to join our team.About the Role:8-10 years of experience as Big Data engineerHands on experience with HadoopExperience on Tableau, PowerBI, Alteryx (any one is required)Experience on Data Lakehouse, DatabricksGood knowledge and working...

  • Senior Big Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataLead Full time $150,000 - $180,000

    Big Data Lead Job Description">Overview:We are seeking a highly skilled Big Data Lead to join our team. The successful candidate will have extensive experience in managing and leading big data projects, with a strong background in Hadoop, Tableau, PowerBI, Alteryx, Data Lakehouse, Databricks, Teradata, and SQL Server.">Key Responsibilities:The Big Data Lead...

  • Big Data Engineering Manager

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time $150,000 - $180,000

    Job OpportunityLead a team of engineers to design, develop and implement scalable big data solutions using Java, Scala/Spark and API technologies.