Data & AI Platforms Engineer

The Opportunity

At APA, our purpose is to secure Australia's energy future. We're not doing it alone. We're doing it with our customers and communities as Australia's energy infrastructure partner, a role our unique experience and expertise positions us to play.

We now have an exciting opportunity available for a Data & AI Platforms Engineer to join us in our Technology team in Melbourne or Sydney on a full-time permanent basis.

Reporting to the Data & AI Platforms Manager, this role seeks an experienced Databricks Administrator to manage and optimise our Databricks environment on AWS. The ideal candidate will possess in-depth expertise and hands-on experience with Databricks, including its architecture, components, and capabilities. Complemented by strong proficiency in cloud environments, the role requires a collaborative professional who can effectively support data engineering teams in harnessing Databricks for large-scale data processing and analytics, driving impactful business outcomes.

Key Responsibilities

• Configure and manage Identity and Access Management (IAM) within the Databricks environment to ensure secure and appropriate access control.

• Administer, oversee, and monitor Databricks clusters on AWS, maintaining optimal performance and functionality.

• Partner with AWS and Databricks support teams to resolve complex technical issues and enhance system reliability.

• Collaborate closely with cloud architects, data engineers, and security teams to facilitate seamless integration with AWS services.

• Work in partnership with data governance teams to promote and implement best practices in data management.

• Support the implementation of robust network security measures, including VPC configurations and firewall rules, to safeguard the platform.

Your background

• Bachelor's degree in computer science or a related field. 

• Strong experience in Databricks administration.

• Strong experience with Databricks on AWS, including cluster management, performance tuning, security, and data entitlements management.

• Experience in the utilities sector (desirable).

• Familiarity with AWS services (e.g., S3, DMS, EC2, IAM, Lambda, Glue) and their integration with Databricks.

• Proficiency in scripting languages (e.g., Python, SQL, Bash) for automation.

• Familiarity with DevOps Tools (e.g., Gitlab)

About the Team

Technology underpins everything we do at APA from helping connect millions of Australians to essential energy sources every day to achieving our net zero ambition - and the capability for our people to make this happen. 

To help APA power ahead, the Technology teams is focused on enhancing APAs technology offering, providing innovative and progressive technology - enabling APA to be world class in energy solutions. 

This is an exciting time for the team, we need people who are courageous, nimble, and ready to make an impact - change makers and risk takers. 

Working at APA

At APA we're committed to fostering a safe and inclusive workplace where you can achieve your best. We'll provide you with access to targeted career development programs, competitive remuneration, employee benefits, flexible working arrangements, and wellbeing programs. We also have an inclusive parental leave policy providing 18 weeks leave including superannuation to support parents at work and in life.

We employ more than 2700 people across Australia and are committed to creating a diverse and inclusive culture, where everyone feels safe, valued, and trusted to do their best every day.

We are APA

APA Group is a leading Australian energy infrastructure business.

We proudly own, operate and manage a diverse $26 billion portfolio of gas, electricity, solar and wind assets which deliver essential services to communities and customers across Australia. And we own more than 15,000 kilometres of gas pipelines which deliver energy to households and businesses across every corner of Australia.

As the partner of choice in delivering infrastructure solutions for the energy transition, we're focused on bundled remote grid energy solutions, electricity and gas transmission, and future energy, including hydrogen and carbon capture and storage.

Our customer centric approach means we understand our customers and offer them reliable, innovative, and cost-effective energy solutions that support their decarbonisation ambitions.

We are committed to securing Australia's energy future by delivering infrastructure solutions for Australia's energy transition and supporting the decarbonisation ambitions of our customers and communities.

Join our team and be part of securing Australia's energy future. We'd love to hear from you.

APA is an equal opportunity employer. The safety, health and wellbeing our people, community and environment a priority. We embrace diversity in our people to ensure our workforce is representative of the communities that we operate in.

Applicants must be eligible to work in Australia to be considered.

This vacancy works with critical APA data, systems or infrastructure and candidates are subject to background vetting (including Police checks) before & during employment.

APA Group will not accept unsolicited resumes from recruitment agencies.

We will contact successful candidates after the closing date.