Senior Data Engineer

1 month ago


Sydney, New South Wales, Australia COGNIZANT Full time
About the Role

Cognizant is seeking a highly skilled Senior/Lead Data Engineer to join our team. As a key member of our big data engineering team, you will be responsible for designing and building complex big data pipelines using Pyspark and Scala.

Key Responsibilities
  • Design and build/configure big data pipelines as per the design
  • Identify and solve big data problems independently
  • Work closely with big data developers to report any issues in build
  • Work on defect fixes during QA & UAT
  • Work through the life cycle of the code from low-level design to production and post-production support
Requirements
  • Strong technical and analytic skills to solve complex big data problems
  • Experienced with Spark software stack, prior experience in working on Spark using Python or Scala or Java and PySpark based big data implementations
  • Strong knowledge and hands-on experience with HDFS, Map reduce, Hive, Impala, Tej, Sqoop, Pig, Oozie, HBase, Cassandra, Mongo DB, Kafka, Spark, Storm, Knox, Ranger, Flume, NiFi, Falcon, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator, and Ambari
  • Good experience in CICD & DevOps concepts
  • Good experience working in any cloud environment (Azure/AWS/GCP) using Agile methodology
What We Offer

Cognizant offers a competitive salary range of over $100,000 and a chance to work with a leading professional services company. If you are passionate about big data engineering and want to make a difference in the world, we want to hear from you.

Please apply directly with us. For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers. Cognizant is committed to providing Equal Employment Opportunities.


  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe're a leading property marketplace that simplifies the property journey for all involved. Our business is driven by expertise and exclusive data, and we're committed to innovation and excellence.Job DescriptionWe're seeking a Senior Data Engineer to join our Data Decision Science team. As a key member of our cross-functional team, you'll work on...

  • Senior Data Engineer

    1 month ago


    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe're a leading property marketplace that simplifies the property journey for all involved. Our business is driven by expertise and exclusive data, aiming to change the way people engage with property.Job DescriptionWe're seeking a Senior Data Engineer to join our Data Decision Science team. As a key member of our cross-functional team, you'll work...

  • Senior Data Engineer

    3 weeks ago


    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to design, implement, and support telemetry systems and reporting solutions within our IT environments. The...


  • Sydney, New South Wales, Australia Senior Full time

    About AccelerationAcceleration is a specialist practice for data, analytics & technology consulting. We are a team of highly skilled data and technology practitioners who are inspired by experimentation and new ideas. Our future-forward solutions empower our clients to compete every day in a dynamic environment.We help clients leverage the power of data,...

  • Senior Data Engineer

    2 months ago


    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team, creating an inclusive workplace that promotes and values diversity.About the RoleWe are seeking a Senior Data Engineer to design, implement and...

  • Senior Data Engineer

    3 weeks ago


    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About Us:CDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Headquartered in Canberra, our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute environments with all campuses interconnected with high-speed carrier grade...

  • Senior Data Engineer

    1 month ago


    Sydney, New South Wales, Australia CDC Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Established in 2007, we have a strong presence in the ACT, NSW, and New Zealand, with a diverse range of operations that support co-location, containerised, and hyperscale compute environments.We are committed to creating an inclusive...

  • Senior Data Engineer

    3 weeks ago


    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our company was established in 2007 and has since grown to become a major player in the industry.We are headquartered in Canberra and have multiple facilities in the ACT, NSW, and New Zealand. Our diversified operations provide secure data...


  • Sydney, New South Wales, Australia Dicker Data Full time

    Job Description:As a senior software engineer in data analysis, you will be responsible for developing and maintaining large-scale data processing systems. Your primary focus will be on designing and implementing data pipelines using Python, ensuring data quality and integrity. You will work closely with cross-functional teams to deliver high-quality...

  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.About the RoleWe are seeking a Senior Data Engineer to design, implement and support telemetry systems and reporting solutions within our IT Environments.Key ResponsibilitiesDesign, implement and support complex data processing...

  • Senior Data Engineer

    3 weeks ago


    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to design, implement, and support telemetry systems and reporting solutions within our IT environments.The...

  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia CDC Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Established in 2007, we have a strong presence in Canberra, NSW, and New Zealand, with a diverse range of operations that provide secure data centre configurations for co-location, containerised, and hyperscale compute environments.We are...

  • Senior Data Engineer

    3 weeks ago


    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About Cdc Data Centres:We are a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute environments with all campuses interconnected with high-speed carrier grade networks.We are passionate about...

  • Senior Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia CDC Data Centres Full time

    About CDC Data CentresWe are a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team by creating an inclusive workplace that promotes and values diversity.About the RoleWe are seeking a highly skilled Senior Data Engineer to design,...


  • Sydney, New South Wales, Australia PARK Senior Villas Chandler Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team in Sydney. As a key member of our Application Modernisation team, you will be responsible for designing and implementing cutting-edge software solutions that guide customers in transitioning their applications from relational databases to MongoDB.Key...


  • Sydney, New South Wales, Australia PARK Senior Villas Chandler Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at MongoDB. As a key member of our Application Modernization team, you will be responsible for designing and implementing cutting-edge software solutions that enable our customers to transition their applications from relational databases to MongoDB.Key...

  • Senior Data Architect

    2 weeks ago


    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About Us:Cdc Data Centres is a leading operator of sovereign, secure, world-class data centre facilities. Our company has been established since 2007, with multiple facilities in the ACT, NSW and New Zealand.Headquartered in Canberra, our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale...

  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia The Drive Group Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at The Drive Group. As a Senior Data Engineer, you will play a key role in designing and implementing large-scale data infrastructure on Google Cloud Platform (GCP).Key Responsibilities:Design and deploy scalable data pipelines using GCP servicesDevelop and maintain...


  • Sydney, New South Wales, Australia Cdc Data Centres Full time

    About us:CDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.We are headquartered in Canberra and have multiple facilities in the ACT, NSW, and New Zealand.Our mission is to attract, retain, and grow the world's best data centre team.We value diversity and believe that everyone's unique experiences...

  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia Versent Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Versent. As a Senior Data Engineer, you will play a key role in designing, building, and maintaining data processing systems that meet the needs of our clients.ResponsibilitiesDesign and implement data pipelines using AWS servicesDevelop and maintain data processing...