Technical lead Data Engineer

2 months ago

Sydney, New South Wales, Australia Cognizant Full time
Job Description

What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU - people with an entrepreneurial spirit who want to make a difference in this world.

At Cognizant, together with your colleagues from all around the world, you will collaborate on creating solutions for the world's leading companies and help them become more flexible, more innovative, and successful. Moreover, this is your chance to be part of the success story.

Position Summary:

• Experience in Solution designing, Application Development, Application Support and Project management for Insurance, Banking, Retail, and E-commerce Domains. Professional with deep understanding of object-oriented analysis and design with extensive experience in building software.

• As a Lead Data Engineer, will be responsible for Solution designing, implementing, and maintaining scalable ETL data pipelines and infrastructure to support their technologies in the data stack: AWS Cloud Computing Services, DataStage ETL, Databricks, python, git and more.

• Develop efficient, reusable, and reliable code using modern programming languages and frameworks.

• Possess analytical, troubleshooting and issue resolution skills, able to work independently & cross functionally within a team.

• Participate in agile ceremonies such as stand-ups, retrospectives, sprint planning and demos.

• Ability to work closely with customer, technical architect, and team members to contribute to technical proposals, estimate effort with realistic schedule.
  • Experience in data profiling, source-target mappings, ETL development, SQL optimization, Performance Tuning, testing, and implementation.
  • To build on CI/CD pipeline, Jenkins.
  • Collaborate with team members on code branching, merging, and release management.
    • Proven ability to lead and motivate high performance teams.

    • History of building software systems with improved functionality and productivity, consistently meeting critical requirements.

    • Extensive knowledge in Release activities and process improvements around release management.

    Mandatory Skills:

    • Primary Skills - Amazon AWS Redshift, AWS Cloud services, DataStage ETL Technology & Data warehousing

    • Extensively worked on AWS Redshift, AWS services: serverless computing (lambda, step functions), RDS, DMS, DMA, Dynamo DB, S3, SQS, SNS, ECS and Aurora RDS.

    • Programming languages: Java, python, Unix Shell scripting, Kafka

    • Knowledge/Experience in Databricks, DBT

    • Excellent knowledge/experience in DataStage ETL Technology & Data warehousing.

    • Strong SQL background, with capability to Write SQL with a performance mindset, troubleshoot performance, mentor, and train other staff.

    • Experience in Netezza, Teradata, Oracle, SQL Server, and DB2 database.

    • Experience in CI/CD pipeline, Jenkins.

    • GCP Services such as Cloud Functions, Fire store, Pub/Sub

    • Very good understanding & experience of Docker Containers.

    • Fluent with Linux and shell scripting

    • Maintaining customer data in secured environment.

    • Good communication skills, team player

    • Strong hands-on experience in design, development and test using micro service, Jira, GitHub.

    Duties and Responsibilities:

    • Create solution architectures/designs based on Journeys/requirements.

    • Understand the requirement feeds which are sent and conduct feasibility analysis of data movement, migration from DataStage version 9.1 to 11.7 along with their functionality and designing end to end migration into AWS Cloud environment for this project.

    • Construction of Data stage ETL jobs, SQL scripts, AWS Redshift data load and scheduling the jobs through Control M scheduler.

    • To build and develop the CI/CD pipeline in Jenkins.

    • Develop solutions that are resilient, self-healing and Cloud Native. Involved into Design and implementation of secure, scalable, fault tolerant systems in a Cloud.

    • Investigate and resolve complex technical issues and bugs. Collaborate with the support team to address customer-reported problems.

    • Work with PO's/Stakeholders, engineering, and domain architects in creating solutions.

    • Stay abreast of industry trends and emerging technologies. Evaluate and recommend new tools, frameworks, and methodologies to enhance the development process.

    • Mentoring team, Participating in RFP's, New initiatives, Innovations, Technical Interviews etc.,

    • Code review, System Integration Testing support, Production release activities and Production release warranty support.

    • Excellent problem-solving and critical-thinking skills.

    • Ability to adapt to changing priorities and work effectively in a fast-paced environment.

    • Demonstrate a commitment to continuous learning and professional development.

    Salary Range: > $100,000

    Next Steps: If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you Please apply directly with us. For a complete list of open opportunities with Cognizant, visit is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.

    About Cognizant:

    Cognizant (Nasdaq-100: CTSH) is one of the world's leading professional services companies, transforming clients' business, operating and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build and run more innovative and efficient businesses. Learn how Cognizant helps clients lead with digital at or follow us @Cognizant.

    Employee Status : Full Time Employee

    Shift : Day Job

    Travel : No

    Job Posting : May

    About Cognizant
    Cognizant (Nasdaq-100: CTSH) is one of the world's leading professional services companies, transforming clients' business, operating and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant is ranked 185 on the Fortune 500 and is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital at or follow us @Cognizant.

  • Senior Azure Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA Full time

    Job Description NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network...

  • Technical lead Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position Summary: Experience in Solution designing, Application Development, Application Support and Project management for Insurance, Banking, Retail, and E-commerce Domains. Professional with deep understanding of object-oriented analysis and design with extensive experience in building software.As a Lead Data Engineer, will be responsible for Solution...

  • Technical lead Data Engineer

    1 month ago

    Sydney, New South Wales, Australia Cognizant Full time

    Position Summary: Experience in Solution designing, Application Development, Application Support and Project management for Insurance, Banking, Retail, and E-commerce Domains. Professional with deep understanding of object-oriented analysis and design with extensive experience in building software.As a Lead Data Engineer, will be responsible for Solution...

  • Technical lead Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cognizant Technology Solutions Full time

    Job Description What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world.At Cognizant, together with your colleagues from all around the world, you...

  • Technical lead Data Engineer

    2 months ago

    Sydney, New South Wales, Australia Cognizant Technology Solutions Full time

    Job Description What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world.At Cognizant, together with your colleagues from all around the world, you...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Troocoo Full time

    About our client: Our client is an instantly recognisable household name within the Financial Services industry. In recent years they have led the way in the creation of wealth management products and services for their customers. Due to this expansion in their offering and associated customer acquisition, they are seeking a Lead Data Engineer to join and...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia ClearCompany Full time

    Lead Data Engineer (Dev Ops)Sydney, Australia$220,000 Including Super + BonusOverview:As a Lead Data Engineer reporting to our Engineering Manager, you will be responsible for building, implementing, and enhancing enterprise-scale data platforms.Working in a Dev Ops environment, you will have end-to-end accountability for designing, developing, deploying,...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Thoughtworks Full time

    Data ArchitectWe are looking for a skilled professional to join our team as a Data Architect. At our company, you'll have the opportunity to work on cutting-edge data projects and collaborate with talented teammates to solve challenging business problems. Take a look at the responsibilities and requirements below:Develop and implement modern data...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Talenza Full time

    Lead Data Engineer (DevOps) Sydney, Australia $220,000 Including Super + Bonus Overview: As a Lead Data Engineer reporting to our Engineering Manager, you will be responsible for building, implementing, and enhancing enterprise-scale data platforms. Working in a DevOps environment, you will have end-to-end accountability for designing, developing,...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Referrals Only Full time

    Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems....

  • Data Technical Lead

    2 weeks ago

    Sydney, New South Wales, Australia ARQ Group Full time

    ARQ, Dialog, CatapultBI, ICEMEDIA, Eighty20, Riley and AccessHQ are now all part of NCS Australia.About us:We are NCS Australia We have brought together Australia's best tech talent, working as one to harness technology and advance our communities, to make the extraordinary happen. We're proud of our rich history of partnering with our clients to develop end...

  • Lead Technical Solutions Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Media Full time

    The Company Media.Monks is a digital-first marketing, data, advertising and technology services company connecting the dots across content, data & digital media and technology services. Inspired by the connectivity and flexibility of technology APIs, Media.Monks' single-P&L model offers brands seamless access to a nearly 9,000-strong team of digital...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Macquarie Bank Limited Full time

    Join our Banking and Financial Services data engineering team to help build the best technology company in the financial services industry. Help us build the next evolution of our Data and Analytics Platforms. Joining our team means you'll get to use innovative approaches to data analytics and play a lead role in shaping and driving this forward. At...

  • Lead Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Ing Bank N.v. Full time

    Great new opportunity for a "Lead Data Engineer – Cloud" to join our Data tribe at ING.Reporting to the Program Director, this role will be working with large volumes of data, both structured and unstructured, and implementing data solutions on the Azure platform.You'll be responsible for design and build of complex data pipelines and extending platform...

  • Technical Lead

    2 weeks ago

    Sydney, New South Wales, Australia Quantexa Full time

    Founded in 2016 with only a handful of individuals, Quantexa was built with a purpose that through a greater understanding of context, better decisions can be made. 7 years, 15 locations and 650+ employees later we still believe that today. We connect the dots within our customers data using dynamic entity resolution and advanced network analytics to create...

  • Lead Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Randstad Australia Full time

    About the company: My client is a leading global multinational investment banking and financial services company. You will be joining the data engineering team to help build the best technology company in the financial services industry. You will play a leading role in shaping and driving the next evolution of their data and analytics platform, providing...

  • Lead Data Engineer

    1 month ago

    Sydney, New South Wales, Australia Randstad Australia Full time

    About the company: My client is a leading global multinational investment banking and financial services company. You will be joining the data engineering team to help build the best technology company in the financial services industry. You will play a leading role in shaping and driving the next evolution of their data and analytics platform, providing...

  • Lead Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Randstad Australia Full time

    About the company: My client is a leading global multinational investment banking and financial services company. You will be joining the data engineering team to help build the best technology company in the financial services industry. You will play a leading role in shaping and driving the next evolution of their data and analytics platform, providing...

  • Technical Lead

    2 weeks ago

    Sydney, New South Wales, Australia Quantexa Full time

    What we're all about.It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. We're a real...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Bancroft School Full time

    The Data Engineer is responsible for building and supporting the big data platform.As a Data Engineer, your responsibilities include: Develop, test and support future-ready data solutions for customers across industry verticals Develop, test and support end-to-end batch and near real-time data flows/pipelines Demonstrate understanding in data architectures,...