Cloud Infrastructure Engineer

4 hours ago

Sydney, New South Wales, Australia Avance Consulting Full time
Job Title: Senior Systems Engineer

We are seeking a highly skilled Senior Systems Engineer to join our team at Avance Consulting. As a key member of our Platform Team, you will play a crucial role in the migration of Hadoop-based systems to AWS cloud environments.

Key Responsibilities:
  • Design, implement, and manage cloud infrastructure for data replication and processing.
  • Configure and maintain AWS services such as S3, EMR, Glue, and Redshift/Snowflake.
  • Migrate on-premise Hadoop components (e.g., HDFS, Hive, HBase) to AWS.
  • Set up and manage data replication processes between on-premise and AWS environments.
  • Optimize performance and scalability of cloud-based data processing systems.
  • Develop and maintain infrastructure as code (IaC) using tools like Terraform or AWS CloudFormation.
  • Monitor and troubleshoot infrastructure and data replication issues.
  • Implement and manage security controls to protect data and infrastructure.
  • Collaborate with Data Engineers and other teams to ensure data integrity and availability.
  • Document infrastructure configurations, processes, and best practices.
  • Automate repetitive tasks and processes to improve efficiency.
  • Conduct regular performance reviews and capacity planning for cloud resources.
  • Stay updated with the latest cloud technologies and industry trends.
  • Provide support for disaster recovery and backup strategies.
  • Perform root cause analysis for system failures and implement corrective actions.
  • Ensure compliance with organizational policies and industry regulations.
  • Participate in on-call support rotation for infrastructure issues.
  • Assist in the development of migration strategies and plans.
  • Develop and execute test plans to ensure successful migration.
  • Contribute to knowledge sharing and training for other team members.
Requirements:
  • Bachelor's/Master's degree in Engineering or related field.
  • 6-10 years of experience with technologies including Spark, Oracle 11g, Hive, HDFS, Hadoop, and AWS services.
  • Experience with CBA (Commonwealth Bank) is preferred.
  • Primary Skillset (must-have)
    • Strong experience with AWS cloud services (S3, EMR, Glue, Redshift/Snowflake).
    • Expertise in Hadoop ecosystem components (HDFS, Hive, HBase).
    • Proficiency in AWS Infrastructure, data replication and migration strategies.
    • Experience with infrastructure as code (IaC) tools (Terraform, CloudFormation).
    • Knowledge of performance optimization and scalability practices.
  • Secondary Skills
    • Experience with additional AWS services (Lake Formation, Glue Catalog).
    • Familiarity with data processing frameworks (Apache Spark).
    • Knowledge of data security and compliance standards.
  • Certifications
    • AWS Certified Solutions Architect or AWS Certified DevOps Engineer.
    • Certifications in Cloudera or similar Hadoop-related technologies are preferred.
  • Relevant Exp
    • 5+ years in cloud engineering, data replication, and infrastructure management.

We are looking for a highly skilled and experienced Senior Systems Engineer to join our team at Avance Consulting. If you have a strong background in cloud engineering, data replication, and infrastructure management, we encourage you to apply for this exciting opportunity.

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia 2 Sigma Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at 2 Sigma. As a key member of our infrastructure team, you will be responsible for designing, deploying, and managing scalable and secure cloud-based solutions for our clients.Key ResponsibilitiesDesign and implement cloud architectures using Terraform and...

  • Cloud Infrastructure Engineer

    6 days ago

    Sydney, New South Wales, Australia Opus Recruitment Solutions Full time

    Job SummaryWe are seeking an experienced Cloud Infrastructure Engineer to join our team at Opus Recruitment Solutions. As a Cloud Infrastructure Engineer, you will be responsible for providing technical support to our clients and ensuring the smooth operation of their cloud infrastructure.About the RoleThis is a fantastic opportunity to work with a leading...

  • Cloud Infrastructure Engineer

    5 days ago

    Sydney, New South Wales, Australia Crypto Recruit Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Crypto Recruit. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing our cloud infrastructure to support our growth and scalability.Key ResponsibilitiesDesign and Implement Cloud Infrastructure: Collaborate with our...

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia Bluefin Resources Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Bluefin Resources. As a GCP Specialist, you will be responsible for designing, implementing, and managing complex cloud environments.Key ResponsibilitiesDesign and implement scalable and secure cloud infrastructure using GCP servicesDevelop and maintain...

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia 2 Sigma Full time

    About 2 SigmaWe are a leading consulting firm that helps businesses navigate complex challenges and achieve their goals. With a strong focus on innovation and a diverse range of services, we empower clients across industries to thrive.Job SummaryWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team. As a Cloud Infrastructure...

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia Uniquehire Pty LTD Full time

    Job Title: DevOps/SRE EngineerAbout the Role:We are seeking a highly skilled DevOps/SRE Engineer to join our team at Uniquehire Pty LTD. As a key member of our infrastructure team, you will be responsible for building and maintaining our cloud infrastructure using AWS and OnPrem technologies.Key Responsibilities:Design and implement Site Reliability...

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia Avance Consulting Full time

    About the RoleAs a Cloud Engineer at Avance Consulting, you will play a crucial role in the migration of Hadoop-based systems to AWS. Your responsibilities will include setting up and managing cloud infrastructure, ensuring seamless data replication, and optimizing the performance of data processing systems.You will work closely with other engineering teams...

  • Cloud Infrastructure Engineer

    4 days ago

    Sydney, New South Wales, Australia Crypto Recruit Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Crypto Recruit. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing a highly scalable and secure infrastructure to support our growth.Key ResponsibilitiesCollaborate with our team of Software Engineers to design...

  • Cloud Infrastructure Engineer

    5 days ago

    Sydney, New South Wales, Australia Saul Recruitment Full time

    About the RoleSaul Recruitment is seeking a highly skilled Cloud Engineer to join our team. As a Cloud Engineer, you will be responsible for designing, implementing, and managing cloud-based systems and infrastructure for our clients.Key ResponsibilitiesDesign and implement cloud-based systems and infrastructure to meet client requirementsDevelop and...

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia Expertech Full time

    Job Title: Cloud DevOps EngineerJob Summary:Expertech is seeking a highly skilled Cloud DevOps Engineer to join our team. As a Cloud DevOps Engineer, you will be responsible for building, maintaining, and optimizing self-service infrastructure delivering and driving an agile, stable, and secure platform across public and private clouds and data centers.Key...

  • Cloud Infrastructure Engineer

    5 days ago

    Sydney, New South Wales, Australia ClearCompany Full time

    Job Title: Cloud DevOps EngineerJob Summary:We are seeking a highly skilled Cloud DevOps Engineer to join our team at ClearCompany. As a Cloud DevOps Engineer, you will be responsible for building, maintaining, and optimizing self-service infrastructure to deliver an agile, stable, and secure platform across public and private clouds and data centers.Key...

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia Uniquehire Pty LTD Full time

    Job Title: DevOps/SRE EngineerAbout the Role:We are seeking an experienced DevOps/SRE Engineer to join our team at Uniquehire Pty LTD. As a key member of our infrastructure team, you will be responsible for building and maintaining our cloud infrastructure using AWS and OnPrem technologies.Key Responsibilities:Design and implement Site Reliability...

  • Cloud Infrastructure Engineer

    3 days ago

    Sydney, New South Wales, Australia Australian Payments Plus Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Australian Payments Plus. As a key member of our infrastructure team, you will play a critical role in designing, implementing, and maintaining our cloud-based infrastructure.Key ResponsibilitiesDesign and implement scalable and reliable cloud infrastructure...

  • Cloud Infrastructure Engineer

    5 days ago

    Sydney, New South Wales, Australia Amazon Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our Enterprise Network team at Amazon. As a key member of our team, you will be responsible for designing and developing software systems that are secure, maintainable, scalable, and extendable.Key ResponsibilitiesDesign and develop software systems that meet the needs of our...

  • Cloud Infrastructure Engineer

    4 days ago

    Sydney, New South Wales, Australia Amazon Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Amazon. As a key member of our Enterprise Office Network Edge Engineering team, you will be responsible for designing, developing, and deploying cloud-based infrastructure solutions that enable our business to scale and grow.Key ResponsibilitiesDesign and develop...

  • Cloud Infrastructure Engineer

    3 days ago

    Sydney, New South Wales, Australia Expertech Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Expertech. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure.Key ResponsibilitiesDesign and Implement Cloud Infrastructure: You will be responsible for designing and...

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia Expertech Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Expertech. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure.Key ResponsibilitiesDesign and Implement Cloud Infrastructure: You will be responsible for designing and...

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia ClearCompany Full time

    Job Summary:The Cloud DevOps Engineer will be responsible for building, maintaining, optimizing, and uplifting self-service infrastructure delivering and driving an agile, stable, and secure platform across public and private clouds and data centers.Key Responsibilities:Design and deploy cloud-first services, collaborating closely with product management,...

  • Cloud Infrastructure Engineer

    3 days ago

    Sydney, New South Wales, Australia Expertech Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Expertech. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure.Key ResponsibilitiesDesign and Implement Cloud Infrastructure: You will be responsible for designing and...

  • Cloud Infrastructure Engineer

    7 days ago

    Sydney, New South Wales, Australia Amazon Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our Enterprise Network team at Amazon. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and secure cloud infrastructure solutions.Key ResponsibilitiesDesign and Develop Cloud Infrastructure Solutions: You will work on...