Current jobs related to Data Engineering Lead - Sydney, New South Wales - ClearCompany

  • Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia rich Data Co Full time

    About RDCRich Data Co (RDC) Delivering the Future of Credit, Today We believe credit should be accessible, fair, inclusive, and sustainable. We are passionate about AI and developing new techniques that leverage traditional and non-traditional data to get the right decision in a clear and explainable way. Global leading financial institutions are leveraging...

  • Cloud Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia One51 | Data & Analytics Consultancy Full time

    We are seeking an experienced Cloud Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and developing scalable data architectures using Microsoft Azure.About the Role:Design and implement ETL pipelines using Azure Data Factory (ADF) and ELT processes.Develop and maintain large-scale data...

  • Data Engineering Lead

    4 weeks ago

    Sydney, New South Wales, Australia Talent Insights Group Full time

    Senior Data Consultant at Talent InsightsLocation: Sydney (Hybrid Work)Position Type: Full-Time, PermanentAn exciting opportunity has arisen for a hands-on, proactive Data Engineering Lead to join a leading Insurance company based in Sydney.In this role, you will be responsible for leading a team of 2-4 data engineers, working as part of a global team on...

  • Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia Talent Insights Group Full time

    Senior Data Consultant at Talent InsightsLocation: Sydney (Hybrid Work)Position Type: Full-Time, PermanentAn exciting opportunity has arisen for a hands-on, proactive Data Engineering Lead to join a leading Insurance company based in Sydney.In this role, you will be responsible for leading a team of 2-4 data engineers, working as part of a global team on...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia PayTech Nexus Ltd Full time

    Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team at PayTech Nexus Ltd. As a key member of our data engineering team, you will be responsible for designing, building, and delivering high-quality data solutions.About the RoleDesign and develop complex data pipelines using Big Data technologies such as Hadoop, Spark, and...

  • Data Engineering Lead

    20 hours ago

    Sydney, New South Wales, Australia Qantas Full time

    Welcome to Qantas, a leading airline in AustraliaWe're looking for talented individuals to join our Data & Analytics team, where you'll have the opportunity to drive innovation and shape the future of our data platforms. As a Senior Data Engineer, you'll work closely with cross-functional teams to develop scalable and efficient data solutions using modern...

  • Lead Data Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    Job Description for Lead Data Engineer in SydneyExperience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data Engineering and Data WarehousingSolution Design and Data AnalysisData Visualization and Data ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data...

  • Lead Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    Job Description for Lead Data Engineer in SydneyExperience: 10+ years in Software Engineering, Cloud Computing, Databricks, and Big Data.Key Responsibilities:Data Engineering and Data WarehousingSolution Design and Data AnalysisData Visualization and Data ModelingProgramming Languages: Python, Scala, SQLCloud Technologies: Azure and DatabricksBig Data...

  • Data Engineer Lead

    3 days ago

    Sydney, New South Wales, Australia Monash University Full time

    We are seeking a highly skilled Data Engineer Lead to join our team at Monash University. This is an exciting opportunity for a technical expert to lead innovative data solutions and drive the development of high-quality, scalable data assets.About the RoleThe successful candidate will be responsible for designing, developing, and maintaining data pipelines...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia ResMed Inc Full time

    Global Technology Solutions at ResMed IncThe Global Technology Solutions (GTS) division at ResMed Inc is dedicated to creating innovative platforms and services for patients, providers, and partners. Our primary goal is to accelerate well-being and growth by transforming core operations, enabling patient and partner outcomes, and building future-ready...

  • Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia Macquarie Bank Limited Full time

    At Macquarie Bank Limited, we're looking for a seasoned professional to spearhead our data engineering efforts. As a Data Engineering Lead, you will be responsible for overseeing the development and implementation of our data platforms, ensuring they are scalable, maintainable, and performant.You will lead a team of talented engineers, providing guidance and...

  • Data Engineering Lead

    6 days ago

    Sydney, New South Wales, Australia Atlassian Full time

    Job DescriptionAs a Senior Data Engineer at Atlassian, you will play a critical role in designing and implementing large-scale data processing systems. You will lead business growth by enhancing product experiences and collaborating with Product, Engineering, Research and Data Scientists across programs.Your responsibilities will include extracting/cleaning...

  • Data Analyst for Search Engine Improvement

    2 weeks ago

    Sydney, New South Wales, Australia Welo Data Full time

    Job DescriptionWe are seeking a highly skilled Data Analyst to join our team in improving search engine quality. As a Web Information Assessor, you will play a crucial role in ensuring the accuracy and relevance of search results.About the JobReview and assess internet search results to evaluate their relevance and accuracy.Provide feedback to improve search...

  • Data Engineer Lead

    6 days ago

    Sydney, New South Wales, Australia LMG Full time

    About the RoleAt LMG, we are seeking a highly skilled Senior Data Engineer to lead our data engineering practice. As a key member of the Data and Analytics team, you will be responsible for designing and building end-to-end pipelines and workflows to ingest data from our CRM, revenue systems, and external data sources.You will develop integration pipes to...

  • Lead Data Engineer

    4 weeks ago

    Sydney, New South Wales, Australia Paxus - Technology + Digital Talent Full time

    Permanent Opportunity open to interstate candidatesGenerous remunerationFlexible Working ArrangementOur client is looking for a Lead Data Engineer to shape their data platform and strategy. You will be the leader of making technical decisions, ensuring operational excellence, best engineering practices, and strategic vision across multiple projects.Key...

  • Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia Whizdom Full time

    About the Role:As a Technical Lead for Data Solutions, you will be responsible for designing and developing future-ready data solutions for customers across various industry verticals.Your key responsibilities will include producing detailed solution designs, supporting data engineers and testers as a technical lead in data projects, developing and testing...

  • Data Engineering Lead

    2 weeks ago

    Sydney, New South Wales, Australia Macquarie Bank Limited Part time

    Join our Group Treasury Transformation Liquidity Technology team as a Lead Data Engineer.We carry an exciting program of work to deliver our next-generation Liquidity Platform.This is an excellent opportunity for someone with a keen interest in Finance (Group Treasury), Data, and Technology.At Macquarie, our advantage is bringing together diverse people and...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia Tech Mahindra Full time

    Job Summary:We are seeking a highly skilled Data Engineering Lead to join our team at Tech Mahindra. In this role, you will be responsible for designing and building scalable data pipelines and workflows on the Databricks platform.About Us:Tech Mahindra is a leading provider of digital transformation, consulting, and business re-engineering services and...

  • Data Engineer Lead

    1 week ago

    Sydney, New South Wales, Australia Atlassian Full time

    About the RoleWe're seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. As a key member of our team, you'll design and implement large-scale data processing systems, collaborate with cross-functional teams, and drive business growth through data-driven insights.Key ResponsibilitiesDesign and develop scalable data pipelines...

  • Data Engineering Lead

    1 week ago

    Sydney, New South Wales, Australia Binance Full time

    Binance is a leading global blockchain ecosystem behind the world's largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 250 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products.Our...

Data Engineering Lead

3 weeks ago

Sydney, New South Wales, Australia ClearCompany Full time

Job Summary:

We are seeking an experienced Data Engineering Lead to join our team at ClearCompany.

This is a 12 + 12 month contract opportunity for two lead data engineers who will be responsible for designing, building, testing, and maintaining data pipelines to move data between systems.

The ideal candidate will have five years of experience working as a Data Pipeline Engineer in a Cloud Computing environment and a solid understanding of cloud-based architecture relating to data storage and pipelines.

About the Role:

  • Design: Creating scalable data pipelines that meet project requirements.
  • Maintain: Optimising pipelines for performance and scalability.
  • Monitor: Troubleshooting issues and documenting processes.
  • Collaborate: Working with analysts and data scientists to understand data needs.
  • Automate: Writing scripts to automate repetitive tasks.

Key Responsibilities:

  • Technical expertise in scripting languages (e.g. AWS Glue, HashiCorp Terraform).
  • Solid understanding of cloud-based architecture relating to data storage and pipelines.
  • Understanding of data processing of streams (e.g. AWS Kinesis).
  • Understanding and being able to implement security and access controls around data pipelines.
  • Experience in data pipeline ETL tools (e.g. AWS Glue, Informatica, DBT, Talend etc).
  • Very good SQL skills.
  • Tertiary qualifications in an ICT related field or applicable industry certifications.

Requirements:

  • Five years' experience working as a Data Pipeline Engineer in a Cloud Computing environment.
  • Demonstrated AWS as it relates to Data Storage, Extraction, Transformation, Data processing frameworks.
  • A proficient understanding of security concepts around the above areas.
  • Experience with Agile development methodologies.