Cloud Data Engineer

• You are proficient in Cloud technologies AWS, Big Data, Teradata, DevSecOps, and Gen AI.

• We are one of the largest and most advanced Data/Cloud Engineering teams in the country.

• Together we can build state-of-the-art cloud and data solutions that power seamless experiences for millions of customers

Do work that matters

As an experienced data cloud engineer with proven expertise in cloud technology and database development, you're ahead of trends and work at the forefront of Data warehouse, Big Data and Cloud technologies.

As a member of the Technology division, you will contribute to all aspects of the technology products and services we deliver, from technical strategy and design to coding to deployment to operation.

See yourself in our team

Join the Business Banking (BB) Technology team at CommBank, where we're driving innovation through Digital and Gen AI platforms that empower our Business Bank customers.

Our team plays a pivotal role in delivering secure, reliable, and actionable data products. These assets support strategic decision-making, risk management, and customer success. This is driven by critical data assets which is supported by the Data Engineering teams within the BB Technology who are responsible for ingesting data, creating ESDM aligned Data Products and creating reports which will help business come up with strategies.

We're interested in hearing from people who:

• Think AI-first and are passionate about solving problems with intelligent data solutions.

• Pride themselves on their experience and knowledge with building data mesh architectures with AWS services, including S3, AWS Glue, EMR, Kinesis, Lake formation and IAM roles and permissions 

• Strong software development background using Python, Spark or DBT/SQL 

• Have expertise in data integration, cleansing, modelling, warehousing, and developing pipelines. 

• DevSecOps mindset, with a drive to automate processes and workflows 

• Are knowledgeable of payments solutions and Merchants products.

• Well experienced in different Ingestion and egress Frameworks using AWS Cloud native services.

• Must have AWS Data engineer Certification.

In a typical day you will:

• Design and implement databases, data models, and ETL processes to ingest and transform large volumes of data from diverse sources.

• Develop and maintain scripts for real-time and batch data processing, utilizing AWS services and Big Data technologies.

• Create, optimize, and troubleshoot data pipelines, ensuring reliability and performance across various data environments (e.g., Hadoop, Spark, Teradata).

• Collaborate closely with business and technical teams to build critical databases and data pipelines supporting digital banking services.

• Contribute to the technical strategy, solution design, coding, deployment, and ongoing operation of data products and services

Tech skills

We use a broad range of tools, languages, and frameworks. We don't expect you to know them all but having significant experience and exposure with some of these (or equivalents) will set you up for success in this team.

• AWS Certified Data Engineer Associate with demonstrable experience in Data Engineering.

• Data Processing: Strong expertise in Python, PySpark, SQL, Spark, Java and distributed data processing.

• Experience in AWS Data products such as AWS Glue ,RedShift, AWS EMR, AWS Lambda, Athena, Kinesis, MSK, Iceberg , Data Zone.

• AWS Aurora RDS such as PostgreSQL

• AWS S3 ingestion, transformation and writing to databases

• Realtime streaming technologies, MSK Kafka, Flink

• Data Governance & Security: Experience with AWS Lambda ,AWS DataZone, Lake Formation, IAM, encryption.

• Experience in using AI Powered coding Assistants like Cline, Roo and Aider.

• Marketplace & APIs: Exposure to AWS Marketplace, API Gateway, and data monetization strategies.

• Automation & CI/CD: Experience with Terraform, CloudFormation, GitOps, and serverless frameworks.

• Performance Optimisation: Ability to fine-tune ETL jobs, query performance, and cost efficiencies.

• Experience with Snowflake, or Apache Iceberg.

• Knowledge of data product thinking and data mesh principles.

Working with us

Whether you're passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you.

Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive, and flexible workplace. One where we're driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day.

Here, you'll thrive. You'll be supported when faced with challenges and empowered to tackle new opportunities. We're hiring technologists from across all of Australia and have opened technology hubs in Melbourne, Adelaide, Brisbane and Perth. We really love working here, and we think you will too.

If this sounds like the role for you then we would love to hear from you. Apply today

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We're keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on