Lead Data Engineer
6 days ago
- Extensive experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions
- Strong Data Architecture expertise including different data modelling techniques and design patterns (conceptual, logical, physical, semantic is preferred)
- Strong knowledge of data governance such as data lineage, technical metadata, data quality and reconciliation
- Ability to drive platform efficiency through automation and AI capabilities
- AWS Data Stack: EMR, Glue, Redshift, Athena, S3, Lambda, ECS
- Data Orchestration & Pipelines: Airflow, Dataform
- Data Formats & Modelling: Iceberg, JSON, XML, CSV, Data Modelling Programming & DevOps: Python, SQL, Git, GitHub Actions, Team City, Jenkins, Octopus Unix shell scripting
- ETL & Ingestion: File ingress/egress solutions in AWS
- Security and Observability: DevSecOps, Artifactory, Observability tooling
- Testing & Automation: test automation frameworks, Jupyter Notebooks
- Familiarity with data warehousing and build experience in Teradata, Oracle
- Experience in visualisation tools such as PowerBI, Tableau
- Familiarity and experience with Agile processes
- AWS Data Engineer Associate certification
-
Lead Data Engineer
6 days ago
Sydney, New South Wales, Australia tekFinder Full time $180,000 - $200,000 per yearHiring; Lead Data Engineer - ETL - AWS - SQL*You must live in Sydney for this role as 3 days per week in office are needed.We need a strong Data Tech Lead who can work on solution design from end to end and has a background in Spark SQL, AWS, ETL.This is not a hands off manager role - this is from someone who was once a strong data engineer with ETL/SQL and...
-
Lead Data Engineer
12 hours ago
Sydney, New South Wales, Australia APA Group Full time $120,000 - $180,000 per yearThe OpportunityAt APA, our purpose is to secure Australia's energy future. We're not doing it alone. We're doing it with our customers and communities as Australia's energy infrastructure partner, a role our unique experience and expertise positions us to play.We now have an exciting opportunity available for a Lead Data Engineer in Melbourne, Adelaide,...
-
Lead GCP Data Engineer
1 week ago
Sydney, New South Wales, Australia Talent Insights Group Pty Ltd Full time $120,000 - $180,000 per yearSenior / Lead Data Engineer ( GCP / BigQuery / SQL ) – 6-Month Contract Sydney / Hybrid (3 days in office) $ a day including super 6 Months (with potential for extension)About the Opportunity We are seeking two experienced Senior / Lead Data Engineers to join a greenfield data platform project for a boutique Data & AI consultancy who are working with a...
-
Lead Data Engineer – AWS
2 weeks ago
Sydney, New South Wales, Australia Bluefin Resources Pty Limited Full time $80,000 - $140,000 per yearJoin a high-performing Data team that's driving a large-scale transformation program within the banking and financial services industry. This is an excellent opportunity for an ambitious and technically strong Data Engineer to play a lead role in shaping a modern, cloud-based data platform. You'll be joining a collaborative, forward-thinking environment...
-
Data Engineering Lead
6 days ago
Sydney, New South Wales, Australia Blackmores Group Full time $180,000 - $250,000 per yearWe are hiring aLead Data Engineerto join our Data & Analytics team.Purpose:Blackmores is on a journey to revamp their Data and Analytics (DNA) landscape to move from diagnostics analytics to predictive and prescriptive analytics. We are bringing in world class tools like Snowflake,Fivetran,Coalesceto build a platform which will enable us to change the DNA of...
-
Lead Data Engineer
4 days ago
Sydney, New South Wales, Australia HCF Corporation Full time $150,000 - $200,000 per yearThis role exists to provide data engineering solutions with automated frameworks to the applications on data platform used by the organization to ensure a scalable and reliable solutionResponsibilitiesDesign, develop and implement complex data solutions to meet business, technical and user requirements. Lead engineering best practices to uplift capability...
-
Lead Data Engineer
1 week ago
Sydney, New South Wales, Australia Macquarie Group Full time $120,000 - $200,000 per yearJoin our high performing Data Team focused on collaborating across a wide range of business and technical stakeholders to deliver a transformation project within Macquarie's Banking and Financial Services division. This is an excellent opportunity for an ambitious, problem solving and technical data professional to contribute and grow rapidly within the...
-
Lead Reference Data Engineer
3 days ago
Sydney, New South Wales, Australia Jobs via eFinancialCareers Full time $120,000 - $200,000 per yearOur global financial trading client seeks an experienced Lead Reference Data Engineer. In this high-impact role, you'll be responsible for building and maintaining the systems that power trading strategies. You will design, develop, and manage the critical pipelines that ensure the quantitative researchers and traders have access to the accurate, timely, and...
-
Lead Data Engineer
2 weeks ago
Sydney, New South Wales, Australia Feedzai Full time $150,000 - $250,000 per yearFeedzai is the world's first RiskOps platform for financial risk management, and the market leader in safeguarding global commerce with today's most advanced cloud-based risk management platform, powered by machine learning and artificial intelligence. Feedzai is securing the transition to a cashless world while enabling digital trust in every transaction...
-
Lead Data Engineer
2 days ago
Sydney, New South Wales, Australia Ubank Full time $120,000 - $180,000 per yearAt Ubank, we empower the digital generation to achieve financial success. Think of us as your daily money companion, offering a unified view of your finances with smart features and real-time insights. Save more, track spending, and achieve home ownership faster with Ubank.RoleThe role is part of the Data & Analytics (D&A) 'centre of expertise' aimed at...