Data Engineering Leader

1 day ago


Sydney, New South Wales, Australia Cognizant Full time

About Cognizant

Cognizant is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build, and run more innovative and efficient businesses.

Estimated Salary: $120,000 - $180,000 per year

We are seeking an experienced Data Engineering Leader to join our team. As a key player in our dynamic team, you will have the opportunity to design and implement cutting-edge solutions for leading Australian organizations, leveraging the power of Databricks to solve complex business challenges.

Key Responsibilities:

  • Diving deep into customer objectives, goals, and challenges, positioning yourself as a trusted advisor in their data transformation journey.
  • Spearheading the design and deployment of large-scale Databricks environments on Azure and/or AWS, setting new industry benchmarks.
  • Collaborating with cross-functional teams to architect optimal data solutions and enhance analytical capabilities, driving innovation across organizations.
  • Crafting, developing, and maintaining scalable data pipelines, reusable frameworks, and platforms using Databricks, contributing to our growing suite of proprietary solutions.
  • Staying at the cutting edge of data engineering and cloud technologies, ensuring Cognizant remains a step ahead in the rapidly evolving tech landscape.
  • Optimizing cluster performance and resource allocation to enhance processing efficiency and minimize costs.
  • Mentoring junior engineers and fostering knowledge sharing within the team, contributing to our culture of continuous growth and excellence.

Required Skills and Qualifications:

  • Mastery of Databricks core components including DataFrames, Datasets, Spark SQL, Delta Lake, Databricks Notebook, DBFS, and Databricks Connect.
  • Hands-on experience architecting with Databricks, Azure Data Services, and related technologies, with Azure and/or AWS Databricks certifications.
  • Strong understanding of data architecture principles, including data modeling, ETL processes, data governance, data quality, privacy, and security controls.
  • Proficiency in SQL, data analysis tools, and familiarity with programming languages such as Python, PySpark, Scala, and others.
  • Exceptional problem-solving skills with the ability to analyze complex issues and develop effective, scalable solutions.
  • Excellent communication skills: Strong written and verbal abilities to effectively collaborate with team members and stakeholders at all levels.
  • Familiarity with AWS or Azure for deploying and optimizing Databricks environments.

Benefits:

  • Competitive salary range.
  • Opportunities for career growth and professional development.
  • A collaborative and inclusive work environment.
  • A comprehensive benefits package, including health insurance, retirement plans, and paid time off.

Location: Sydney or Melbourne, Australia.



  • Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading provider of sovereign and secure data centre facilities in Australia.We are passionate about creating an inclusive workplace that promotes diversity and values individual experiences. Our mission is to attract, retain, and grow the world's best data centre team.Our team is dedicated to delivering meaningful benefits for...

  • Data Engineer

    1 week ago


    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    Drive Business Value with Data Engineering at Domain GroupWe are seeking a skilled Data Engineer to join our Data Decision Science team in Sydney. As a key member of our data department, you will play a critical role in building scalable data pipelines that power Australia's property market.About the RoleThis is an exciting opportunity to work with...


  • Sydney, New South Wales, Australia The Drive Group Full time

    Unlock Your Data Engineering PotentialWe are seeking a talented Data Engineer Leader to join our team at The Drive Group, a fast-growing Australian consultancy. This exciting opportunity will allow you to utilize your expertise in data engineering concepts and techniques to drive business growth.As a Data Engineer Leader, you will be responsible for...


  • Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About Pyramid Global TechnologiesJob Title: Data Engineering Leader Job Description:Sr. Data Engineer *Power BI,*Tableau,*SQL advanced,*Data warehousing concepts, and everything related to data We are seeking an experienced Data Engineering Leader to join our team at Pyramid Global Technologies. As a key member of our organization, you will be responsible...

  • Data Engineer

    1 week ago


    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe shine a light on the property market, simplifying the journey for all involved. Our expertise and exclusive data drive change. At Domain Group, our data department leads the way in driving value across the organisation.The RoleAs a Senior Data Engineer, you'll play a key role in building data pipelines that power Australia's property market....


  • Sydney, New South Wales, Australia Quantexa Full time

    At Quantexa, we're passionate about making data easier. We believe that by harnessing the power of data analytics, businesses can grow and make a positive impact on their communities.We're currently seeking an experienced Data Engineering Leader to join our team. As a key member of our delivery team, you will be responsible for leading and mentoring junior...


  • Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Solutions Data Engineer to join our team at Data-Property Data Solns Shared. As a Senior member of our organization, you will play a critical role in shaping the future of property data solutions.About UsWe shine a light on all things property, aiming to simplify the property journey for all involved. Our business is motivated...


  • Sydney, New South Wales, Australia Lendi Group Full time

    We are seeking an exceptional Data Engineering Leader to join our team at Lendi Group. This role offers a unique opportunity to lead our data engineering function and drive the development of innovative data solutions.Job SummaryLead the design, development, and implementation of modern data architectures and pipelines.Collaborate with cross-functional teams...


  • Sydney, New South Wales, Australia Databricks Full time

    Job Title: Cloud Data Engineering LeaderWe are seeking an experienced Cloud Data Engineering Leader to join our team at Databricks. As a key member of our pre-sales organization, you will play a critical role in guiding customers through the evaluation and adoption of our Data Intelligence Platform.


  • Sydney, New South Wales, Australia CDC Data Centres Full time

    About us: CDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team, promoting an inclusive workplace that values diversity.We believe that everyone's unique experiences enable us to deliver meaningful benefits for...


  • Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Our mission is to attract, retain, and grow the world's best data centre team.About the RoleWe are seeking a Technical Solutions Engineer to provide thought leadership, planning, management, and technical design development for our...


  • Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Senior Data Engineer to join our Single View Property (SVP) team at Domain. This role is perfect for someone who thrives in a dynamic environment and has a passion for working with data to drive business outcomes.


  • Sydney, New South Wales, Australia Simple Machines Full time

    Company OverviewSimple Machines is a pioneering technology firm with a global presence, offering bespoke data solutions at the intersection of data, AI, machine learning, and software engineering.We help enterprises, technology companies, and governments unlock the potential of data through innovative technologies and tailored services. Our mission is to...


  • Sydney, New South Wales, Australia Dicker Data Full time

    Job Description:As a senior software engineer in data analysis, you will be responsible for developing and maintaining large-scale data processing systems. Your primary focus will be on designing and implementing data pipelines using Python, ensuring data quality and integrity. You will work closely with cross-functional teams to deliver high-quality...


  • Sydney, New South Wales, Australia Data-Property Data Solns Shared Full time

    We are seeking a highly skilled Senior Data Engineer to join our team at Data-Property Data Solutions Shared. This is an exciting opportunity for a seasoned professional to lead the development of cutting-edge data solutions and drive business growth.About UsOur company specializes in simplifying the property journey for all stakeholders, leveraging our...


  • Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About Pyramid Global TechnologiesEstimated Salary: $140,000 - $180,000 per yearJob Description:Job SummaryWe are seeking a highly skilled Data Engineering Leader to join our team at Pyramid Global Technologies.Key ResponsibilitiesDesign and develop advanced data warehousing concepts and solutionsLeverage Power BI, Tableau, and SQL advanced for data analysis...


  • Sydney, New South Wales, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Established in 2007, our company has grown to become the largest provider of co-location, containerised and hyperscale compute environments with high-speed carrier-grade networks connecting all campuses.We are committed to creating an...


  • Sydney, New South Wales, Australia Databricks Full time

    Company OverviewDatabricks is a leader in the field of cloud computing and data analytics, providing a platform that enables users to process and analyze large datasets quickly and efficiently.SalaryThe estimated salary for this position is $140,000 - $180,000 per year, depending on experience and qualifications.Job DescriptionWe are seeking an experienced...


  • Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    We are seeking a highly skilled Data Engineer and Innovation Leader to join our team at the Commonwealth Bank of Australia. This is an exciting opportunity for a passionate data professional to lead on medium to complex products and product development, applying advanced technical knowledge of data engineering principles and practices.About UsAt the...


  • Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe shine a light on all things property, simplifying the journey for everyone involved. Our expertise and exclusive data drive value across the organisation.Role OverviewThis is an exciting opportunity to make your mark in data engineering at Domain Group's Data Decision Science team. You'll play a key role in building data pipelines that power...