Big Data Developer

Position Summary: We are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies. You will be responsible for developing data pipelines, transform large volumes of data, and optimizing data infrastructure to enable real-time and batch processing for business insights and analytics.

• Design, develop and maintain scalable and secure big data processing systems using tools like Apache Spark, Hadoop, Hive, Kafka, etc.
• Build and optimize data pipelines and architectures for data ingestion, processing and storage from diverse sources (structured, semi-structured, unstructured).
• Develop ETL/ELT workflows and data transformation logic using custom code in Python, Scala, Java and job scheduling tools such as Control-M.
• Translate business needs/requirements into technical specifications, develop application strategy and high-level design documentation.
• Involve in solution design discussions, competitive displacement, proof-of-concept engagements, solution demonstrations and technical workshops.
• Manage development sprints effectively and efficiently from planning to execution to review in an agile development environment.
• Convert business knowledge into technical knowledge and vice versa and translate insights into frontline action.
• Build and manage end-to-end big data streaming/batch pipelines as per business requirements.
• Report and update management/customers about issues/blockers in a timely manner to mitigate risk.
• Collaborate with different teams, analysts and stakeholders to understand data requirements and deliver efficient data solutions.
• Ensure data quality, consistency and security by implementing data validation, logging, monitoring, and governance standards.
• Tune and monitor the performance of data systems, jobs and queries.
• Integrate and manage data platforms in Azure cloud environment.
• Mentor junior developers and support team best practices in code review, version control, and testing.
• Document system designs, data flows, and technical specifications.
• Proactively identify and eliminate impediments and facilitate flow.
• Experience in project management software (i.e., JIRA, Manuscript, etc.) to support task estimates and execution.
• Involve in engineering development projects and facilitate sprint releases.
• Create reusable assets / supporting artifacts based on the industry landscape.

• Bachelor's or master's degree in computer science, data engineering, information technology, or related fields.
• 4+ years of experience in Big Data technologies.
• Experience in template-oriented data validation / cleansing framework.
• Strong programming skills in Python, Scala, Shell Scripting and Java.
• Extensive experience in data transformation and building ETL pipelines using PySpark.
• Strong knowledge in performance improvements of existing big data streaming or batch pipelines.
• Proficiency in big data tools and frameworks such as Apache Spark, Hadoop, Kafka, and Hive.
• Strong proficiency in design and development of generic ingestion and streaming frameworks usable by new initiatives/projects.
• Experience with NoSQL Databases – HBase and Azure Cosmos DB.
• Experience in optimizing high-volume data load in Spark.
• Deep knowledge of the Azure cloud platform.
• Experience in identifying complex data lineage using Apache Atlas.
• Strong knowledge of creating, scheduling and monitoring jobs using Control-M.
• Strong knowledge in data analysis, NLP, ML techniques, and data visualization.
• Deep understanding of data governance tool – Alex.
• Strong understanding of BFS domain.
• Build predictive models and machine-learning algorithms.
• Present information using data visualization techniques.

• Primary Skills: Hadoop – Expert
• Apache Spark – Expert
• Apache Atlas – Expert
• Python – Expert
• Scala – Expert
• Shell Script – Expert
• PySpark – Expert
• Scikitlearn – Expert
• Matplotlib – Expert
• Azure Storage Explorer – Expert
  • Database Skills: HBase – Expert
  • Hive – Expert
  • Oracle – Expert
  • SqlServer – Expert
  • MySQL – Expert
  • Cosmos DB – Expert
    • Other Skills: NLP – Expert
    • ML – Expert
    • Data Science – Expert
    • Data Visualization – Expert
      • Tools: PyCharm/VSCode - Advanced
      • Control M – Advanced
      • Code Versioning Tool - Advanced
      • Project Management tools (JIRA, Confluence, Service NOW) – Advanced
      • MS Visio - Expert
      • HP ALM/QC- Expert
      Salary

Salary Range: $75,000-$85,000

Date of Posting: 25/August/2025

If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you Please apply directly with us.

For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers. Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.

#LI-CTSAPAC