Senior Data Architect

2 months ago


Lindfield, New South Wales, Australia Commonwealth Bank Full time

We are seeking an experienced Senior Data Engineer to join our team at Commonwealth Bank.

About the Role

This is a key analytics role that requires passion and expertise in building data-driven solutions using AWS Cloud technologies.

As a Senior Data Engineer, you will be part of a highly advanced data engineering team responsible for creating world-leading analytics capabilities and driving digital transformation across the bank.

You will have the opportunity to build state-of-the-art data platforms and pipelines, leveraging latest technologies such as Scala, Python, PySpark, SQL Server, Oracle, Teradata, and cloud platforms.

Key Responsibilities
  • Design, develop, and implement scalable data architectures and pipelines using cloud-based technologies.
  • Collaborate with cross-functional teams to integrate large sets of data from internal and external sources.
  • Become proficient in building effective and efficient data lake frameworks, capabilities, and features.
  • Leverage automation tools like Airflow, Glue ETL, DMS, EMR, KMS, MSK, S3, and CFN/CDK to optimize data ingestion, integration, and pipeline delivery.
Requirements
  • 5+ years of experience in software development and programming with strong expertise in data engineering and cloud technologies.
  • Demonstrated experience in designing and implementing complex data architectures and pipelines.
  • Proficiency in programming languages such as Python, PySpark, Scala, and Advanced SQL.
  • Familiarity with traditional data warehouse concepts (Facts/Dims, normalization) and event-driven data architecture.
  • Experience working with cloud-based storage systems such as S3 and cloud-based databases.
  • Strong knowledge of data security and management principles.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.
Benefits

Commonwealth Bank offers a competitive salary range of $140,000 - $180,000 per annum, depending on experience.

You will also receive comprehensive benefits, including flexible working arrangements, professional development opportunities, and a culture that values diversity and inclusion.

Our employees enjoy a great work-life balance, access to cutting-edge technology, and a supportive environment that fosters creativity and innovation.