Lead Data Engineer

22 hours ago

Sydney, New South Wales, Australia INGRITY Full time $120,000 - $180,000 per year
Location: Sydney Job Type: Contract
We are looking for an experienced Lead Data Engineer with deep hands-on expertise in Data and ETL to lead strategic initiatives and transform our data platform. You will leverage your technical leadership, strategic thinking, and problem-solving skills to guide a team of engineers, enhance platform efficiency through AI and automation, and manage business and technical stakeholders effectively.
Your Impact:
  • Lead the design, development, and optimization of large-scale data pipelines and platforms.
  • Take full ownership of projects, driving them from conception to delivery while managing business and technical stakeholders successfully.
  • Make decisive technical and strategic decisions to ensure project success and platform efficiency.
  • Mentor and guide a team of data engineers, setting best practices and technical standards.
  • Ensure robust data architecture, governance, and quality across all data initiatives.

Your Expertise:
  • Expert in Big Data technologies including Spark, Hive, Presto (or other query engines), and big data storage formats (Parquet, ORC, Avro).
  • Strong Spark SQL expertise with proven ability in query tuning and optimization.
  • Hands-on experience with data integration tools such as Talend, DataStage, or Informatica, and building/maintaining data warehouses.
  • Strong experience with AWS (EC2, S3, RDS, EMR) and GCP.
  • Proficient in Airflow for orchestrating data pipelines.
  • Strong data architecture expertise, including data modeling techniques.
  • Knowledge of data governance, including data lineage, technical metadata, data quality, and reconciliation.
  • Ability to drive platform efficiency through automation and AI, with Python experience preferred.
  • Exceptional stakeholder management skills, able to navigate complex business and technical landscapes effectively.

Why Join Us: You'll be part of a forward-thinking team where innovation meets execution. You'll lead transformative projects, implement cutting-edge technologies, and shape the future of our data platforms while collaborating closely with business and technical stakeholders.
Location: Sydney Job Type: Contract
We are looking for an experienced Lead Data Engineer with deep hands-on expertise in Data and ETL to lead strategic initiatives and transform our data platform. You will leverage your technical leadership, strategic thinking, and problem-solving skills to guide a team of engineers, enhance platform efficiency through AI and automation, and manage business and technical stakeholders effectively.
Your Impact:
  • Lead the design, development, and optimization of large-scale data pipelines and platforms.
  • Take full ownership of projects, driving them from conception to delivery while managing business and technical stakeholders successfully.
  • Make decisive technical and strategic decisions to ensure project success and platform efficiency.
  • Mentor and guide a team of data engineers, setting best practices and technical standards.
  • Ensure robust data architecture, governance, and quality across all data initiatives.

Your Expertise:
  • Expert in Big Data technologies including Spark, Hive, Presto (or other query engines), and big data storage formats (Parquet, ORC, Avro).
  • Strong Spark SQL expertise with proven ability in query tuning and optimization.
  • Hands-on experience with data integration tools such as Talend, DataStage, or Informatica, and building/maintaining data warehouses.
  • Strong experience with AWS (EC2, S3, RDS, EMR) and GCP.
  • Proficient in Airflow for orchestrating data pipelines.
  • Strong data architecture expertise, including data modeling techniques.
  • Knowledge of data governance, including data lineage, technical metadata, data quality, and reconciliation.
  • Ability to drive platform efficiency through automation and AI, with Python experience preferred.
  • Exceptional stakeholder management skills, able to navigate complex business and technical landscapes effectively.

Why Join Us: You'll be part of a forward-thinking team where innovation meets execution. You'll lead transformative projects, implement cutting-edge technologies, and shape the future of our data platforms while collaborating closely with business and technical stakeholders.
Must hold full Australian working rights

About INGRITY:

We are a fast-growing, progressive Sydney-based data & analytics company. We service many large corporates and SMBs in the financial services sector, to derive value from data.

At Ingrity, we are committed to building a diverse and inclusive workforce to deliver value to customers. As a value-driven organisation, we nurture and support our people by having a laser-sharp focus on skill and talent development, collaboration, and flexibility.

  • Data Engineer

    18 hours ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Lead Data Engineer

    24 hours ago

    Sydney, New South Wales, Australia Kapital Consulting Full time $180,000 - $200,000 per year

    Permanent opportunitySydney CBD office | WFH 2 days$180k - $200k + Super + BonusAbout the Role:We are seeking a Lead Data Engineer to take ownership of a data platform supporting critical business functions across the enterprise. This role combines hands-on technical leadership with strategic platform development, ensuring the data ecosystem scales...

  • Data Engineering Lead

    20 hours ago

    Sydney, New South Wales, Australia SEISMA GROUP Full time $180,000 - $300,000 per year

    We're looking for aData Engineering Leadto drive enterprise-scale data platform transformation and lead a team of ~15 data professionals including Engineers, DevOps specialists, Product Owners, and Scrum Masters. You'll be a strategic partner to the CDAO, shaping our clients data infrastructure, advanced analytics capabilities, and regulatory-compliant data...

  • Lead Data Engineer

    1 week ago

    Sydney, New South Wales, Australia tekFinder Full time $180,000 - $200,000 per year

    Hiring; Lead Data Engineer - ETL - AWS - SQL*You must live in Sydney for this role as 3 days per week in office are needed.We need a strong Data Tech Lead who can work on solution design from end to end and has a background in Spark SQL, AWS, ETL.This is not a hands off manager role - this is from someone who was once a strong data engineer with ETL/SQL and...

  • Lead Data Engineer

    3 days ago

    Sydney, New South Wales, Australia APA Group Full time $120,000 - $180,000 per year

    The OpportunityAt APA, our purpose is to secure Australia's energy future. We're not doing it alone. We're doing it with our customers and communities as Australia's energy infrastructure partner, a role our unique experience and expertise positions us to play.We now have an exciting opportunity available for a Lead Data Engineer in Melbourne, Adelaide,...

  • Lead Data Engineer

    21 hours ago

    Sydney, New South Wales, Australia HCF (Australia) Full time $120,000 - $180,000 per year

    This role exists to provide data engineering solutions with automated frameworks to the applications on data platform used by the organization to ensure a scalable and reliable solutionResponsibilitiesDesign, develop and implement complex data solutions to meet business, technical and user requirements.Lead engineering best practices to uplift capability and...

  • Lead GCP Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Talent Insights Group Pty Ltd Full time $120,000 - $180,000 per year

    Senior / Lead Data Engineer ( GCP / BigQuery / SQL ) – 6-Month Contract Sydney / Hybrid (3 days in office) $ a day including super 6 Months (with potential for extension)About the Opportunity We are seeking two experienced Senior / Lead Data Engineers to join a greenfield data platform project for a boutique Data & AI consultancy who are working with a...

  • Lead Data Engineer – AWS

    2 weeks ago

    Sydney, New South Wales, Australia Bluefin Resources Pty Limited Full time $80,000 - $140,000 per year

    Join a high-performing Data team that's driving a large-scale transformation program within the banking and financial services industry. This is an excellent opportunity for an ambitious and technically strong Data Engineer to play a lead role in shaping a modern, cloud-based data platform. You'll be joining a collaborative, forward-thinking environment...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia Blackmores Group Full time $180,000 - $250,000 per year

    We are hiring aLead Data Engineerto join our Data & Analytics team.Purpose:Blackmores is on a journey to revamp their Data and Analytics (DNA) landscape to move from diagnostics analytics to predictive and prescriptive analytics. We are bringing in world class tools like Snowflake,Fivetran,Coalesceto build a platform which will enable us to change the DNA of...

  • Lead Data Engineer

    7 days ago

    Sydney, New South Wales, Australia HCF Corporation Full time $150,000 - $200,000 per year

    This role exists to provide data engineering solutions with automated frameworks to the applications on data platform used by the organization to ensure a scalable and reliable solutionResponsibilitiesDesign, develop and implement complex data solutions to meet business, technical and user requirements. Lead engineering best practices to uplift capability...