Data Engineer

2 weeks ago

Sydney, New South Wales, Australia Cognizant Full time

Role Overview

Cognizant is seeking an exceptional Data Engineer to join our dynamic Databricks practice. As a key player in our team, you will have the opportunity to design and implement cutting-edge solutions for leading Australian organizations, leveraging the power of Databricks to solve complex business challenges.

Key Responsibilities

  • Develop and deploy large-scale Databricks environments on Azure and/or AWS, setting new industry benchmarks.
  • Collaborate with cross-functional teams to architect optimal data solutions and enhance analytical capabilities, driving innovation across organizations.
  • Craft, develop, and maintain scalable data pipelines, reusable frameworks, and platforms using Databricks, contributing to our growing suite of proprietary solutions.
  • Staying at the cutting edge of data engineering and cloud technologies, ensuring Cognizant remains a step ahead in the rapidly evolving tech landscape.
  • Optimize cluster performance and resource allocation to enhance processing efficiency and minimize costs.
  • Monitor and troubleshoot cluster performance issues, implementing solutions to ensure uptime and reliability.

Requirements

  • A minimum of 4 years' experience using Databricks (6+ years for Senior/Principal Consultant roles).
  • Mastery of Databricks core components including DataFrames, Datasets, Spark SQL, Delta Lake, Databricks Notebook, DBFS, and Databricks Connect.
  • Hands-on experience with Databricks, Azure Data Services, and related technologies, with Azure and/or AWS Databricks certifications.
  • In-depth knowledge of the Medallion Architecture or similar data frameworks.
  • Strong understanding of data architecture principles, including data modeling, ETL processes, data governance, data quality, privacy, and security controls.
  • Proficiency in SQL, data analysis tools, and familiarity with programming languages such as Python, PySpark, Scala, and others.
  • Exceptional problem-solving skills with the ability to analyze complex issues and develop effective, scalable solutions.
  • Excellent communication skills: Strong written and verbal abilities to effectively collaborate with team members and stakeholders at all levels.

  • Data Engineer

    10 hours ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    Drive Business Value with Data Engineering at Domain GroupWe are seeking a skilled Data Engineer to join our Data Decision Science team in Sydney. As a key member of our data department, you will play a critical role in building scalable data pipelines that power Australia's property market.About the RoleThis is an exciting opportunity to work with...

  • Data Engineer

    2 days ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe shine a light on the property market, simplifying the journey for all involved. Our expertise and exclusive data drive change. At Domain Group, our data department leads the way in driving value across the organisation.The RoleAs a Senior Data Engineer, you'll play a key role in building data pipelines that power Australia's property market....

  • Data Property Solutions Engineer

    10 hours ago

    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Solutions Data Engineer to join our team at Data-Property Data Solns Shared. As a Senior member of our organization, you will play a critical role in shaping the future of property data solutions.About UsWe shine a light on all things property, aiming to simplify the property journey for all involved. Our business is motivated...

  • Data Centre Engineering Specialist

    4 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About us: CDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team, promoting an inclusive workplace that values diversity.We believe that everyone's unique experiences enable us to deliver meaningful benefits for...

  • Data Centre Engineering Specialist

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Technical Solutions Engineer to provide thought leadership, planning, management, and technical design development for our...

  • Data Engineer for Property Insights

    2 days ago

    Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Senior Data Engineer to join our Single View Property (SVP) team at Domain. This role is perfect for someone who thrives in a dynamic environment and has a passion for working with data to drive business outcomes.

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Senior Data Engineer to design, implement, and support telemetry systems and reporting solutions within our IT environments. The...

  • Senior Software Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Dicker Data Full time

    Job Description:As a senior software engineer in data analysis, you will be responsible for developing and maintaining large-scale data processing systems. Your primary focus will be on designing and implementing data pipelines using Python, ensuring data quality and integrity. You will work closely with cross-functional teams to deliver high-quality...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our company was established in 2007 and has since grown to become a major player in the industry.We are headquartered in Canberra and have multiple facilities in the ACT, NSW, and New Zealand. Our diversified operations provide secure data...

  • Data Centre Design Engineer Position

    5 days ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Established in 2007, our company has grown to become the largest provider of co-location, containerised and hyperscale compute environments with high-speed carrier-grade networks connecting all campuses.We are committed to creating an...

  • Senior Data Engineer

    1 month ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Established in 2007, we have a strong presence in Canberra, NSW, and New Zealand, with a diverse range of operations that provide secure data centre configurations for co-location, containerised, and hyperscale compute environments.We are...

  • Senior Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About Cdc Data Centres:We are a leading operator of sovereign, secure, world-class data centre facilities in Australia. Our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute environments with all campuses interconnected with high-speed carrier grade networks.We are passionate about...

  • Senior Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    About CDC Data CentresWe are a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team by creating an inclusive workplace that promotes and values diversity.About the RoleWe are seeking a highly skilled Senior Data Engineer to design,...

  • Data Engineering Leader

    1 week ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading provider of sovereign and secure data centre facilities in Australia.We are passionate about creating an inclusive workplace that promotes diversity and values individual experiences. Our mission is to attract, retain, and grow the world's best data centre team.Our team is dedicated to delivering meaningful benefits for...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia. Established in 2007, we provide diversified operations with secure data centre configurations that support co-location, containerised and hyperscale compute environments.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to...

  • Data Engineer for Property Market

    5 days ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe are a property marketplace company that aims to simplify the property journey for all involved. Our team is driven by expertise and exclusive data, working together to change the way people engage with property.

  • Senior Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About us:CDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.We are headquartered in Canberra and have multiple facilities in the ACT, NSW, and New Zealand.Our mission is to attract, retain, and grow the world's best data centre team.We value diversity and believe that everyone's unique experiences...

  • Technical Solutions Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About us: CDC Data Centres is a leading provider of secure, world-class data centre facilities in Australia and New Zealand. Established in 2007, we have a strong track record of delivering innovative solutions to our customers. Our team is passionate about creating an inclusive workplace that promotes diversity and values individual experiences. We believe...

  • Senior Data Architect

    3 weeks ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    About Us:Cdc Data Centres is a leading operator of sovereign, secure, world-class data centre facilities. Our company has been established since 2007, with multiple facilities in the ACT, NSW and New Zealand.Headquartered in Canberra, our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale...

  • Data Engineer

    1 month ago

    Sydney, New South Wales, Australia XPT Software Australia Pty Ltd Full time

    Job Title: Data EngineerJob Summary:XPT Software Australia Pty Ltd is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines using Apache Airflow to orchestrate ETL processes. You will also implement and manage data storage solutions on Google Cloud...