Lead Cloud Infrastructure Engineer

3 weeks ago

Sydney, New South Wales, Australia Avance Consulting Full time

Position Overview

We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Avance Consulting. This role requires a seasoned professional with extensive experience in managing cloud environments and data migration processes.

Role Summary

The Cloud Infrastructure Engineer will be pivotal in transitioning on-premise big data systems to AWS cloud platforms. The focus will be on establishing robust infrastructure, ensuring efficient data replication, and enhancing system performance.

Key Responsibilities

1. Architect and oversee cloud infrastructure for data processing and replication.

2. Configure and manage AWS services including S3, EMR, Glue, and Redshift/Snowflake.

3. Facilitate the migration of Hadoop components such as HDFS, Hive, and HBase to AWS.

4. Establish and supervise data replication mechanisms between on-premise and AWS systems.

5. Enhance the performance and scalability of cloud-based data processing frameworks.

6. Develop and maintain Infrastructure as Code (IaC) using tools like Terraform or AWS CloudFormation.

7. Monitor and resolve infrastructure and data replication challenges.

8. Implement security measures to safeguard data and infrastructure.

9. Collaborate with Data Engineers and other teams to maintain data integrity and accessibility.

10. Document infrastructure setups, processes, and best practices.

11. Automate routine tasks to boost operational efficiency.

12. Conduct performance assessments and resource planning for cloud infrastructure.

13. Stay informed about emerging cloud technologies and industry developments.

14. Support disaster recovery and backup initiatives.

15. Analyze root causes of system failures and apply corrective measures.

16. Ensure adherence to organizational policies and industry regulations.

17. Participate in on-call support for infrastructure-related issues.

18. Assist in formulating migration strategies and plans.

19. Develop and execute testing protocols to validate successful migrations.

20. Contribute to team knowledge sharing and training efforts.

Qualifications

A Bachelor's or Master's degree in Engineering or a related discipline.

6-10 years of experience with technologies such as Spark, Oracle 11g, Hive, HDFS, Hadoop, and AWS services.

Experience with CBA (Commonwealth Bank) is preferred.

Essential Skills

Proven expertise in AWS cloud services (S3, EMR, Glue, Redshift/Snowflake).

In-depth knowledge of Hadoop ecosystem components (HDFS, Hive, HBase).

Strong proficiency in AWS infrastructure, data replication, and migration methodologies.

Experience with Infrastructure as Code (IaC) tools (Terraform, CloudFormation).

Understanding of performance optimization and scalability techniques.

Desirable Skills

Familiarity with additional AWS services (Lake Formation, Glue Catalog).

Knowledge of data processing frameworks (Apache Spark).

Awareness of data security and compliance standards.

Certifications

AWS Certified Solutions Architect or AWS Certified DevOps Engineer.

Certifications in Cloudera or similar Hadoop-related technologies are advantageous.

  • Lead Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Avance Consulting Full time

    Position OverviewWe are seeking a seasoned Cloud Infrastructure Engineer to spearhead our efforts in transitioning from on-premise Hadoop systems to AWS cloud environments. This role is pivotal in managing infrastructure and ensuring efficient data replication as part of our migration strategy.Key Responsibilities1. Architect and oversee cloud infrastructure...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Opus Recruitment Solutions Full time

    Job SummaryWe are seeking an experienced Cloud Infrastructure Engineer to join our team at Opus Recruitment Solutions. As a Cloud Infrastructure Engineer, you will be responsible for providing technical support to our clients and ensuring the smooth operation of their cloud infrastructure.About the RoleThis is a fantastic opportunity to work with a leading...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia 2 Sigma Full time

    About 2 SigmaWe are a leading consulting firm that helps businesses navigate complex challenges and achieve their goals. With a strong focus on innovation and a diverse range of services, we empower clients across industries to thrive.Job SummaryWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team. As a Cloud Infrastructure...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia 2 Sigma Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at 2 Sigma. As a key member of our infrastructure team, you will be responsible for designing, deploying, and managing scalable and secure cloud-based solutions for our clients.Key ResponsibilitiesDesign and implement cloud architectures using Terraform and...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Carecone Pty. Ltd. Full time

    Job DescriptionCarecone Pty. Ltd. is seeking a skilled Cloud Infrastructure Engineer to join our team in Sydney, Australia.Key Responsibilities:Design and implement Site Reliability Engineering (SRE) processes and tools in AWS and On Prem environments.Assist infrastructure specialists in provisioning infrastructure using Elastic, Open Shift, and Dev Ops...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Crypto Recruit Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Crypto Recruit. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing our cloud infrastructure to support our growth and scalability.Key ResponsibilitiesDesign and Implement Cloud Infrastructure: Collaborate with our...

  • Cloud Infrastructure Engineer

    1 week ago

    Sydney, New South Wales, Australia 2 Sigma Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at 2 Sigma. As a key member of our cloud team, you will be responsible for designing, deploying, and managing scalable and secure cloud infrastructure solutions.Key ResponsibilitiesDevelop and maintain CI/CD pipelines and other DevOps practicesManage and support...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Bluefin Resources Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Bluefin Resources. As a GCP Specialist, you will be responsible for designing, implementing, and managing complex cloud environments.Key ResponsibilitiesDesign and implement scalable and secure cloud infrastructure using GCP servicesDevelop and maintain...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Uniquehire Pty LTD Full time

    Job Title: DevOps/SRE EngineerAbout the Role:We are seeking a highly skilled DevOps/SRE Engineer to join our team at Uniquehire Pty LTD. As a key member of our infrastructure team, you will be responsible for building and maintaining our cloud infrastructure using AWS and OnPrem technologies.Key Responsibilities:Design and implement Site Reliability...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Avance Consulting Full time

    Job Title: Senior Systems EngineerWe are seeking a highly skilled Senior Systems Engineer to join our team at Avance Consulting. As a key member of our Platform Team, you will play a crucial role in the migration of Hadoop-based systems to AWS cloud environments.Key Responsibilities:Design, implement, and manage cloud infrastructure for data replication and...

  • Cloud Infrastructure Engineer

    1 week ago

    Sydney, New South Wales, Australia Bluefin Resources Full time

    Cloud Engineer Role at Bluefin ResourcesWe are seeking a highly skilled Cloud Engineer to join our team at Bluefin Resources. As a Cloud Engineer, you will be responsible for designing, implementing, and managing complex cloud environments using Google Cloud Platform (GCP) technologies.Key Responsibilities:Design and implement scalable and secure cloud...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Avance Consulting Full time

    About the RoleAs a Cloud Engineer at Avance Consulting, you will play a crucial role in the migration of Hadoop-based systems to AWS. Your responsibilities will include setting up and managing cloud infrastructure, ensuring seamless data replication, and optimizing the performance of data processing systems.You will work closely with other engineering teams...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Crypto Recruit Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Crypto Recruit. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing a highly scalable and secure infrastructure to support our growth.Key ResponsibilitiesCollaborate with our team of Software Engineers to design...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Saul Recruitment Full time

    About the RoleSaul Recruitment is seeking a highly skilled Cloud Engineer to join our team. As a Cloud Engineer, you will be responsible for designing, implementing, and managing cloud-based systems and infrastructure for our clients.Key ResponsibilitiesDesign and implement cloud-based systems and infrastructure to meet client requirementsDevelop and...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Expertech Full time

    Job Title: Cloud DevOps EngineerJob Summary:Expertech is seeking a highly skilled Cloud DevOps Engineer to join our team. As a Cloud DevOps Engineer, you will be responsible for building, maintaining, and optimizing self-service infrastructure delivering and driving an agile, stable, and secure platform across public and private clouds and data centers.Key...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia ClearCompany Full time

    Job Title: Cloud DevOps EngineerJob Summary:We are seeking a highly skilled Cloud DevOps Engineer to join our team at ClearCompany. As a Cloud DevOps Engineer, you will be responsible for building, maintaining, and optimizing self-service infrastructure to deliver an agile, stable, and secure platform across public and private clouds and data centers.Key...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Uniquehire Pty LTD Full time

    Job Title: DevOps/SRE EngineerAbout the Role:We are seeking an experienced DevOps/SRE Engineer to join our team at Uniquehire Pty LTD. As a key member of our infrastructure team, you will be responsible for building and maintaining our cloud infrastructure using AWS and OnPrem technologies.Key Responsibilities:Design and implement Site Reliability...

  • Cloud Infrastructure Engineer

    2 days ago

    Sydney, New South Wales, Australia Expertech Full time

    Cloud DevOps Engineer - Azure, CGP, AWS, Kubernetes, Terraform, CI/CDThe Cloud DevOps Engineer - Azure, CGP, AWS, Kubernetes, Terraform, CI/CD will be responsible for building, maintaining, and optimizing self-service infrastructure to deliver an agile, stable, and secure platform across Public & Private Clouds and Data Centres. Working closely with...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Australian Payments Plus Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Australian Payments Plus. As a key member of our infrastructure team, you will play a critical role in designing, implementing, and maintaining our cloud-based infrastructure.Key ResponsibilitiesDesign and implement scalable and reliable cloud infrastructure...

  • Senior Cloud Infrastructure Engineer

    2 weeks ago

    Sydney, New South Wales, Australia NCS Australia Full time

    About the RoleWe are seeking a highly skilled Senior Cloud Infrastructure Engineer to join our team at NCS Australia. As a key member of our cloud engineering team, you will be responsible for designing, building, and maintaining infrastructure as code and applications built on Google Cloud.Your primary focus will be on designing, deploying, and supporting...