Lead Data Engineer
1 week ago
This role exists to provide data engineering solutions with automated frameworks to the applications on data platform used by the organization to ensure a scalable and reliable solution
Responsibilities
- Design, develop and implement complex data solutions to meet business, technical and user requirements.
- Lead engineering best practices to uplift capability and delivery quality.
- Design and implement data solutions, including data modeling such as Data Vault and different modelling techniques, in close collaboration with the data architect.
- Strong and proven hands-on experience in implementing the business use cases using the data-platform (data warehouse and data lake) tool AWS, Talend, Databricks, Spark, Hive and Snowflake and ETL technologies.
- Work closely with business and other teams for appropriate design and solution.
- Build and optimize data warehouse and data marts ensuring high performance, security and data governance.
- Technical ownership for data and data pipelines to ensure compliance with data and architectural standards.
- Create and maintain documentation for data pipelines, architectures and processes.
- Implement solutions to integrate Gen AI / LLM technologies into data pipelines enabling data enrichment.
- Contribute to the growth of our data engineering practice through automation, and governance uplift.
- Automate engineering solutions to create products to be used across the business.
- Establish and maintain collaboration with research and business teams to converge on the best solutions.
- Explore emerging tools and technologies and integrate to align optimal solutions with business goals.
- Technical ownership for data and data pipelines to ensure compliance with data and architectural standards.
- Responsible for solving problems related to Data Cleansing, Data Quality and Data Security (masking & encryption).
Essential Skills
- Bachelor's or Master's degree in Computer Science / Engineering or a related discipline
- 10 years + of commercial experience in a Data Engineering / ETL & Data Warehouse Development roles ideally in Insurance domain.
- Experience of Talend, Snowflake, Azure, Databricks, AWS ecosystem- EC2, EMR, S3, Aurora, Hive/ Spark etc. is preferred.
- Experience in Gen AI/LLM is preferred.
- Advanced SQL experience, including fluency with PL/SQL procedures
- Basic understanding of data modelling and concepts especially Data Vault and other modelling techniques.
- Strong fundamental knowledge of ETL/ELT and data warehousing concepts.
- Performance tuning and cost optimization in Snowflake and AWS.
- Good understanding of Business Intelligence and Data Management concepts
- Experience in Insurance Domain would be added advantage.
About HCF
At HCF, our purpose is to bring our human touch to healthcare. Since 1932 we've been putting our members and their health first. As Australia's largest not-for-profit health fund, we cover 2 million members with health, life, travel and pet insurance and our vision is to make healthcare understandable, affordable, high quality and member centric.
We want to be true health partners to our members, easily guiding the healthcare choices that are right for them. At HCF, our values are the way we do things and create the necessary culture to help us realise our purpose and deliver our Strategy. Living our values in action we step forward, walk in their shoes, stay human, make it better and get there together.
Culture & Benefits
Purpose-driven passion
We're united by a common purpose: to make healthcare affordable, understandable, high quality and member-focused.
Wellness and work-life balance
Skills
We'll empower you with the necessary skills and tools to support your personal wellbeing journey, ensuring you perform at your best. Our offerings include:
- 50% subsidy on HCF hospital and/or extras cover
- 18 weeks of parental leave for all new parents
- Mental health and wellbeing programs, including workshops, fitness classes, flu vaccinations, skin checks and more
- Discounts on HCF's products, including life, pet and travel Insurance, as well as discounts at Fitness First gyms and on our eyecare products.
Collaboration and inclusivity
We embrace diversity as our strength and are committed to maintaining an inclusive and collaborative work environment. Our workplace is welcoming and safe for all our employees, irrespective of their unique characteristics including age, ethnicity, cultural or spiritual background, gender identity, disability, education and socio-economic status.
Continuous learning and growth
We believe in lifelong learning. HCF provides opportunities for personal and professional development. From workshops to mentorship programs, we encourage your growth and curiosity.
Next steps
If you
require any adjustments
to assist you in making your application or during the recruitment or onboarding process, please reach out to
Talent Acquisition –
to discuss.
We encourage applicants to submit their applications at their earliest convenience, as at HCF, we review applications as they are submitted, and may have filled the role prior to the job closing date.
-
Lead Data Engineer
1 week ago
Greater Sydney Area, Australia Kapital Consulting - Fintech & Executive Search Full time $120,000 - $180,000 per yearLead the strategy, design, and delivery of a scalable enterprise data platform supporting critical business functions.Lead the design, build, and scaling of a modern enterprise data platformDrive best practices in data engineering and platform governanceWork with senior stakeholders to deliver critical data capabilitiesPermanent opportunitySydney CBD office...
-
Data Engineer
1 week ago
Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...
-
Data Engineer
5 days ago
Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...
-
Technical Data Analyst
1 day ago
Greater Sydney Area, Australia One51 | Data & Analytics Consultancy Full time $100,000 - $150,000 per yearAbout One51One51 is a specialist data and analytics consultancy that helps organisations modernise and scale their data platforms. We work at the intersection of cloud architecture, data engineering, and business intelligence, delivering technically sound, business-ready solutions.Our Data Analytics practice plays a pivotal role in transforming insight...
-
Electrical Engineer
2 weeks ago
Greater Sydney Area, Australia DCI Data Centers Full time $150,000 - $200,000 per yearAbout the CompanyAt DCI Data Centers, we are in a company-wide re-set, realigning on how we build, how we connect across teams, and how we deliver for our customers. More than a role, this is an opportunity to build a company on the rise and redefining what success looks like in our field. We are shaping a culture with purpose: respect, humility, and real...
-
Senior Data Engineer
3 days ago
Greater Sydney Area, Australia Adactin Full time $120,000 - $180,000 per yearAdactin Group is a 100% Australian-owned global IT consulting company, headquartered in Sydney. We are a trusted technology partner helping organisations drive end-to-end digital transformation through our deep expertise in Microsoft and AWS ecosystems, AI-powered Digital Engineering, and future-ready Quality Assurance.Our managed delivery approach, backed...
-
Lead Data Scientist
3 days ago
Greater Sydney Area, Australia Talent Insights Group Full time $120,000 - $180,000 per yearThis is a unique Lead Data Scientist opening with a market leader in the e-commerce industry You'll join a collaborative broader data & analytics team of ~15, and will primarily be hands-on leading data science and AI work. You will also play a role in mentoring and as the team grows, lead a small data science squad.What is unique/attractive about this...
-
Data Engineer Consultant
7 days ago
Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...
-
Senior Data Engineer
5 days ago
Greater Sydney Area, Australia HCF Australia Full time $120,000 - $180,000 per yearThis role exists to lead the design, development, and implementation of scalable, secure, and high-performance data engineering solutions that underpin the organisation's data platform and business applications.ResponsibilitiesDesign, develop, and implement complex data pipelines and frameworks that meet business, technical, and user requirements across...
-
Sr Data Engineer
1 week ago
Greater Sydney Area, Australia Synechron Full time $120,000 - $180,000 per yearSynechron is a leading global digital consulting and technology services firm that specializes in delivering innovative solutions across banking, financial services, insurance, and enterprise sectors. With a mission to help clients achieve their digital transformation goals, Synechron combines deep industry expertise with cutting-edge technology to create...