Senior Data Engineer

19 hours ago


Australia Cognizant Full time
About the Role

Cognizant is seeking a highly skilled and collaborative Senior/Lead Data Engineer with hands-on experience in Pyspark & Scala to join our thriving team in Sydney. This full-time role offers an attractive salary and benefits package.

Key Responsibilities
  • Design and build/configure Big data pipelines as per the design, working independently to identify and solve complex big data problems.
  • Collaborate with Big data developers to report any issues in build and work on defect fixes during QA & UAT.
  • Work through the life cycle of the code from low-level design to production and post-production support.
Requirements
  • Strong technical and analytic skills to solve complex big data problems.
  • Experience with Spark software stack, including Python, Scala, and Java, and PySpark-based big data implementations.
  • Strong knowledge and hands-on experience with HDFS, MapReduce, Hive, Impala, Tez, Sqoop, Pig, Oozie, HBase, Cassandra, MongoDB, Kafka, Spark, Storm, Knox, Ranger, Flume, NiFi, Falcon, Kerberos, Sentry, Cloudera Manager, Cloudera Navigator, and Ambari.
  • Good experience in CICD & DevOps concepts and working in cloud environments (Azure/AWS/GCP) using Agile methodology.

If you're a motivated and experienced Data Engineer looking for a new challenge, please get in touch with Cognizant today.



  • Australia Tampa Gardens Senior Living Full time

    About Tampa Gardens Senior LivingTampa Gardens Senior Living is a global advisor specializing in strategy, process engineering, and technology transformation for the senior living industry. We work closely with clients to develop and implement tailored solutions for business challenges in a post-modern ERP landscape.Our ApproachWe take a human-centric...


  • Australia Senior Care Authority of Inland Empire, CA Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Senior Care Authority of Inland Empire, CA. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining our cloud-based data infrastructure.Key ResponsibilitiesCloud Data Engineering: Develop and implement cloud-based data solutions using...

  • GIS Data Engineer

    1 week ago


    Australia ECF Data, LLC Full time

    **About ECF Data, LLC**We are a leading provider of data-driven solutions, operating in the field of geospatial data analysis and engineering. Our team of experts partners with clients to transform businesses using cloud, data, AI, and digital engineering.**Job Summary**We are seeking a highly skilled GIS Data Engineer to join our team. As a GIS Data...


  • Australia PARK Senior Villas Chandler Full time

    About the RoleNearmap is a leading Australian technology company recognized for its innovative approach to creating virtual models of the real world. As a Senior Data Scientist, you will play a key role in shaping the company's AI Map Data team, driving system evolution, data analysis, and customer feedback interpretation.Key ResponsibilitiesDesign and...


  • Australia Discovery Village at the West End – IL Full time

    About the RoleThe Senior Analytics Engineer will play a pivotal role in designing and developing robust data products and analytics solutions for scalable data infrastructure at Discovery Village at the West End – IL. As a Senior Analytics Engineer, you will work closely with the Analytics Engineering team, collaborating on projects, optimizing the...


  • Australia NCCR RNA & Disease Full time

    About NCCR RNA & DiseaseNCCR RNA & Disease is a leading research institution dedicated to advancing our understanding of RNA and its role in disease. We are driven by a mission to create innovative solutions for a better tomorrow.Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be...

  • Senior Data Analyst

    5 days ago


    Australia Lawton Senior Living Full time

    About the RoleCamden Council's innovative Digital Technology & Innovation Branch is seeking a Senior Data Analyst to drive data strategy and insights vital to the business and community. The role involves working with the latest technologies and supporting key data projects, all within an organization that champions professional career development.Key...


  • Australia SENIOR SPIRIT OF ROSELLE PARK Full time

    About the RoleWe are seeking a highly skilled Senior Systems Engineer to join our team at SENIOR SPIRIT OF ROSELLE PARK. As a Senior Systems Engineer, you will be responsible for the ongoing engineering, support, and project delivery of our portfolio of products.Key ResponsibilitiesConceptualize, develop, test, and implement new features in data acquisition,...


  • Australia Geoscience Data Management Full time

    About the RoleWe are seeking a highly skilled Geoscience Data Engineer to join our team at Geoscience Data Management. As a key member of our data management team, you will be responsible for designing, developing, and implementing data management systems and processes to support our business operations.Key Responsibilities:Design and implement data...

  • Senior Data Engineer

    19 hours ago


    Australia Tbwa ChiatDay Inc Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data Infrastructure team at Flex. As a key member of our team, you will be responsible for designing, implementing, and maintaining high-quality data infrastructure services, including data lakes, Kafka, Amazon Kinesis, and data access layers.Key ResponsibilitiesDesign and...

  • Data Analyst

    1 week ago


    Australia ECF Data, LLC Full time

    About ECF Data, LLCECF Data, LLC is a leading provider of data-driven solutions, dedicated to empowering businesses with actionable insights. We are seeking a highly skilled Data Scientist to join our team, reporting directly to the Head of Data Analytics.Key ResponsibilitiesCollaborate with the data team to identify business challenges addressed via...


  • Australia ECF Data, LLC Full time

    Job DescriptionECF Data, LLC is seeking a highly skilled Data Insights Specialist to join their team. As an integral part of the company's data-driven approach, you will play a key role in supporting data science projects and providing bespoke analytical solutions.Key Responsibilities:Data Science Process Management: Collaborate with senior team members and...

  • Data Architect

    1 week ago


    Australia ECF Data, LLC Full time

    About ECF Data, LLCECF Data, LLC is a forward-thinking organization that thrives on innovation and collaboration. We're currently seeking a skilled Data Engineer to join our team and contribute to the development of our cloud-based data engineering solutions.Key ResponsibilitiesDesign and Develop Enterprise Data Engineering SolutionsDevelop and implement...


  • Australia ECF Data, LLC Full time

    About the RoleECF Data, LLC is seeking a highly skilled Data Insights Analyst to join our team. As an Associate Data Scientist, you will play a key role in supporting data science projects and providing bespoke analytical solutions. You will contribute to optimizing marketing performance, improving customer engagement, and driving commercial value.Key...

  • Senior Data Analyst

    1 week ago


    Australia DATA MART Consulting GmbH Full time

    About the RoleWe are seeking a highly skilled Data Scientist to join our team at DATA MART Consulting GmbH. As a key member of our organization, you will play a critical role in driving business growth and decision-making through data-driven insights.Key ResponsibilitiesCollaborate with Cross-Functional Teams: Work closely with product managers, engineers,...


  • Australia Beacon Pointe Full time

    Job Title: Senior Data Engineer, Information Technology – DataAbout the Role:We are seeking a highly skilled Senior Data Engineer to lead our data infrastructure team at Beacon Pointe. As a key member of our organization, you will be responsible for designing, building, and maintaining our data lake-house and analytics environment.Key Responsibilities:Data...


  • Australia Drawboard Pty Ltd Full time

    **About Drawboard Pty Ltd**Drawboard Pty Ltd is a leading Software-as-a-Service (SaaS) company that specializes in creating innovative document markup and collaboration platforms. Our mission is to revolutionize the way people work by reducing paper usage and promoting a more sustainable work environment.**Job Summary**We are seeking an experienced Senior...


  • Australia Maltem Group Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data and Analytics team at Maltem Group. As a Senior Data Engineer, you will be responsible for managing key Big Data platforms using Hadoop (HDFS, Hive, and Impala) on AWS.Key ResponsibilitiesRun Spark jobs on AWS, utilizing Apache Airflow for job orchestration and...


  • Australia Green Light Full time

    4-month contract Part time / full time optionsWork from any location in AU About the Company: Green Light is a leading IT services business in Australia, providing a wide range of services in Security, infrastructure, and Systems Integration to a diverse customer base throughout Australia, New Zealand, SE Asia, and Europe. About the Engagement: Green Light...


  • Australia Sellingbytext Full time

    About SellingbytextSellingbytext is a leading online company that specializes in providing creative solutions to individuals and businesses. With a strong focus on innovation and customer satisfaction, we have established ourselves as a trusted partner in the industry.Job SummaryWe are seeking a highly skilled Senior Data Engineer to provide technical...