Senior Data Engineer

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 219,000+ people across 54 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud.

The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version of themselves that they can be.

At HCLTech Australia, we value the unique perspective and contributions of all individual and we actively encourage applications from Aboriginal and Torres Strait Islander people to apply for this role.

Are you ready to be an important part of this ever-transformational journey?

Location - Sydney, Australia

Job type: Permanent/ Contract

Job Role Overview:

• Primary Skills - (AWS+RED SHIFT) + DBT + Snowflake
• Secondary Skills – Teradata + Snowflake

AWS + Snowflake - Key Responsibilities:

• Understand customer requirements and render those as architectural models that will operate at large scale and high performance. Where customers have architectures prepared, validate them against non-functional requirements and finalize the build model.
• Experience in creating and monitoring SNOW PIPE for continuous data ingestion from source.
• Experience in Loading data into snowflake tables from the internal stage using Snow SQL (CLI)
• Work alongside customers to build data management platforms using AWS products like Elastic Map Reduce (EMR), Redshift, Kinesis, Amazon Machine Learning, Amazon Athena, Lake Formation, S3, AWS Glue, DynamoDB, ElastiCache and the Relational Database Service (RDS)
• Hands on experience in Python.
• Well experience on other AWS services EC2, EMR, Redshift, S3, Streaming services like Kafka, Kinesis, HDFS.
• Experience in AWS + Snowflake/Redshift implementation is must.
• Security of EMR cluster using KMS keys or customer managed keys
• Deep experience on Snowflakes/AWS native data services including Glue, Glue Catalog, EMR, PySpark-EMR, Data Sync, RDS, Data Exchange, Lake Formation, Athena, Apache Airflow and dbt.
• (Secondary) Knowledge on Teradata SQL, Teradata Utilities – TPT, FASTLOAD, MLOAD, FASTEXPORT, TPUMP and Scripting - Bteq & Unix shell scripting
• (Secondary) Knowledge of database technologies Teradata, DataStage, Cloudera, Big data Hadoop
• Render working, high performance data management solutions, as CloudFormation and reusable artifacts for implementation by the customer. Bootstrap using user data scripts will be added advantage
• Prepare architecture and design briefs that outline the key features and decision points of the application built in the Data Lab
• Work with customers to advise on changes as they put these systems live on AWS
• Extract best-practice knowledge, reference architectures, and patterns from these engagements for sharing with the worldwide AWS solution architect community

Basic Qualifications:

• 5 to 10 years of IT experience with 5+ years of experience in Data Engineering and 5+ years of hands-on experience in Snowflake Data/AWS Services (e.g. S3, Glue, Glue Catalog, Lake Formation)
• Strong understanding of Snowflake architecture.
• Strong understanding of Teradata or DataStage architecture. (Secondary)
• Experience with data migration tools like Glue, Data Sync.
• Excellent knowledge of data modeling, data warehousing, ETL processes, and other Data management systems.
• Strong understanding of security and compliance requirements in cloud.
• Experience in Agile development methodologies and version control systems.
• Excellent communication an leadership skills. Ability to work effectively across internal and external organizations and virtual teams.
• AWS Certified Data Analytics – Specialty.
• Experience on Containerization and serverless computing.
• Familiarity with DevOps practices and automation tools.

Preferred Qualifications:

• Technical degrees in computer science, software engineering, or mathematics
• Cloud and Data Engineering background with Migration experience.

Other Skills:

• A critical thinker with strong research, analytics and problem-solving skills
• Self-motivated with a positive attitude and an ability to work independently and or in a team
• Able to work under tight timeline and deliver on complex problems.
• Must be able to work flexible hours (including weekends and nights) as needed.
• A strong team player

Why Us

We are one of the fastest-growing large tech companies in the world, with offices in 50+ countries across the globe and 219,000 employees.

• Our company is extremely diverse with 165 nationalities represented.
• We offer the opportunity to work with colleagues across the globe.
• We offer a virtual-first work environment, promoting a good work-life integration and real flexibility.
• We offer comprehensive benefits for all employees.
• We are a certified great place to work and a top employer in 17 countries, offering a positive work environment that values employee recognition and respect.

Equality & Opportunity for All

Representing 165 nationalities across the globe, we pride ourselves on being an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, colour, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, Aboriginal and Torres Strait Islander people or any other protected classification, in accordance with federal, state, and/or local law

Candidate Data Privacy Notice