Senior Data Architect
2 months ago
We are seeking an experienced Senior Data Engineer to join our team at Commonwealth Bank.
About the RoleThis is a key analytics role that requires passion and expertise in building data-driven solutions using AWS Cloud technologies.
As a Senior Data Engineer, you will be part of a highly advanced data engineering team responsible for creating world-leading analytics capabilities and driving digital transformation across the bank.
You will have the opportunity to build state-of-the-art data platforms and pipelines, leveraging latest technologies such as Scala, Python, PySpark, SQL Server, Oracle, Teradata, and cloud platforms.
Key Responsibilities- Design, develop, and implement scalable data architectures and pipelines using cloud-based technologies.
- Collaborate with cross-functional teams to integrate large sets of data from internal and external sources.
- Become proficient in building effective and efficient data lake frameworks, capabilities, and features.
- Leverage automation tools like Airflow, Glue ETL, DMS, EMR, KMS, MSK, S3, and CFN/CDK to optimize data ingestion, integration, and pipeline delivery.
- 5+ years of experience in software development and programming with strong expertise in data engineering and cloud technologies.
- Demonstrated experience in designing and implementing complex data architectures and pipelines.
- Proficiency in programming languages such as Python, PySpark, Scala, and Advanced SQL.
- Familiarity with traditional data warehouse concepts (Facts/Dims, normalization) and event-driven data architecture.
- Experience working with cloud-based storage systems such as S3 and cloud-based databases.
- Strong knowledge of data security and management principles.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
Commonwealth Bank offers a competitive salary range of $140,000 - $180,000 per annum, depending on experience.
You will also receive comprehensive benefits, including flexible working arrangements, professional development opportunities, and a culture that values diversity and inclusion.
Our employees enjoy a great work-life balance, access to cutting-edge technology, and a supportive environment that fosters creativity and innovation.