Lead Data Engineer

The Opportunity

At APA, our purpose is to secure Australia's energy future. We're not doing it alone. We're doing it with our customers and communities as Australia's energy infrastructure partner, a role our unique experience and expertise positions us to play.

We now have an exciting opportunity available for a Lead Data Engineer in Melbourne, Adelaide, Sydney or Brisbane on a full-time permanent basis.

Reporting to the Transformation & Governance Manager, this role serves as the Lead Data Engineer, requiring extensive expertise in Databricks and AWS, coupled with a proven track record in establishing and developing cloud-based Data Platform teams. The ideal candidate brings hands-on experience with Big Data and Data Lake technologies across both cloud and on-premises environments, a deep understanding of data warehousing methodologies, and a strong focus on improving data quality and documentation processes.

Key Responsibilities

• Lead the design and implementation of data pipelines, ETL processes and data models on AWS Databricks. 

• Ensure the adoption of best practices in data engineering, including data quality, optimisation and security. 

• Translate high-level architecture into actionable implementation plans. 

• Ensuring solutions are scalable, reliable and secure along with mentoring team members. 

• Conduct code reviews, design reviews and ensure the team follows best practices in version control, CI/CD and DevOps for data engineering. 

• Ensure data governance, security and quality standards are maintained throughout the data lifecycle. 

• Monitor and support data management initiatives, including within specific environments like AWS/Databricks. 

Your background

• Bachelor's degree in computer science or a related field.

• Strong experience in data engineering, with a strong focus on Azure Cloud and Azure Databricks.

• Strong understanding of data architecture, data warehousing, data modelling, ETL processes and cloud based technologies.

• Demonstrated experience in mentoring technical teams

• Proficiency across Python, SQL and Scala

• Excellent problem-solving skills and the ability to work under pressure in a fast-paced environment

• Strong communication skills, with the ability to interact effectively with technical and non-technical stakeholders

About the Team

Technology underpins everything we do at APA from helping connect millions of Australians to essential energy sources every day to achieving our net zero ambition - and the capability for our people to make this happen.

To help APA power ahead, the Technology teams is focused on enhancing APAs technology offering, providing innovative and progressive technology - enabling APA to be world class in energy solutions.

This is an exciting time for the team, we need people who are courageous, nimble, and ready to make an impact - change makers and risk takers.

Working at APA

At APA we're committed to fostering a safe and inclusive workplace where you can achieve your best. We'll provide you with access to targeted career development programs, competitive remuneration, employee benefits, flexible working arrangements, and wellbeing programs. We also have an inclusive parental leave policy providing 18 weeks leave including superannuation to support parents at work and in life.

We employ more than 2700 people across Australia and are committed to creating a diverse and inclusive culture, where everyone feels safe, valued, and trusted to do their best every day.

We are APA

APA Group is a leading Australian energy infrastructure business.

We proudly own, operate and manage a diverse $26 billion portfolio of gas, electricity, solar and wind assets which deliver essential services to communities and customers across Australia. And we own more than 15,000 kilometres of gas pipelines which deliver energy to households and businesses across every corner of Australia.

As the partner of choice in delivering infrastructure solutions for the energy transition, we're focused on bundled remote grid energy solutions, electricity and gas transmission, and future energy, including hydrogen and carbon capture and storage.

Our customer centric approach means we understand our customers and offer them reliable, innovative, and cost-effective energy solutions that support their decarbonisation ambitions.

We are committed to securing Australia's energy future by delivering infrastructure solutions for Australia's energy transition and supporting the decarbonisation ambitions of our customers and communities.

Join our team and be part of securing Australia's energy future. We'd love to hear from you.

APA is an equal opportunity employer. The safety, health and wellbeing our people, community and environment a priority. We embrace diversity in our people to ensure our workforce is representative of the communities that we operate in.

Applicants must be eligible to work in Australia to be considered.

This vacancy works with critical APA data, systems or infrastructure and candidates are subject to background vetting (including Police checks) before & during employment.

APA Group will not accept unsolicited resumes from recruitment agencies.

We will contact successful candidates after the closing date.