AWS Hadoop Data Engineer

1 month ago


Sydney, New South Wales, Australia Zone IT Solutions Full time
About the Role

We are seeking an experienced AWS Hadoop Data Engineer to join our team at Zone IT Solutions. As a key member of our digital transformation team, you will be responsible for designing, building, and optimizing data pipelines and processing frameworks on the AWS cloud platform.

Key Responsibilities
  • Design and implement data processing workflows using tools such as Apache Airflow or AWS Step Functions.
  • Develop and maintain large-scale data processing systems using Hadoop ecosystem components like HDFS, Hive, Spark, and MapReduce.
  • Collaborate with cross-functional teams to identify and prioritize data processing requirements.
  • Optimize data pipelines and data warehouses to improve performance and scalability.
  • Stay up-to-date with the latest advancements in Hadoop and AWS technologies.
Requirements
  • Minimum of 8 years of experience as a Data Engineer, with strong expertise in Hadoop ecosystem components.
  • Extensive experience in designing and implementing data processing workflows.
  • Proficiency in programming languages such as Java or Scala.
  • Strong knowledge of AWS services such as S3, EMR, Redshift, Glue, and Athena.
  • Experience in building and optimizing data pipelines and data warehouses.
  • Understanding of data modeling and database design principles.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and collaboration skills to work effectively in a team.
  • AWS Certified Big Data - Specialty certification is a plus.
About Us

Zone IT Solutions is an Australia-based recruitment company specializing in digital, ERP, and larger IT services. We offer flexible, efficient, and collaborative solutions to any organization that requires IT expertise. Our agile, agnostic, and flexible solutions will help you source the IT expertise you need.

We welcome applicants from a diverse range of backgrounds, including Aboriginal and Torres Strait Islander peoples, people from culturally and linguistically diverse (CALD) backgrounds, and people with disabilities.



  • Sydney, New South Wales, Australia Zone IT Solutions Full time

    We are seeking a highly skilled AWS Hadoop Data Engineer to join our team at Zone IT Solutions. This is an exciting opportunity to design, build, and optimize data pipelines and processing frameworks on the AWS cloud platform.Job Description:This role requires a strong background in big data engineering, with expertise in Hadoop ecosystem components like...

  • Big Data Engineer

    3 weeks ago


    Sydney, New South Wales, Australia Zone IT Solutions Full time

    Job DetailsWe are seeking a highly skilled AWS Hadoop Data Engineer to design, build, and optimize data pipelines and processing frameworks on the AWS cloud platform.About the RoleAs a Data Engineer, you will be responsible for architecting and implementing data processing workflows using tools such as Apache Airflow or AWS Step...


  • Sydney, New South Wales, Australia Amazon (AWS) Full time

    This is a Data Centre Operations role with Amazon (AWS) in AU, where you'll work with a leading company to deliver high standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for customers.As a Data Centre Technician in Sydney, you'll be the senior resolver for your support team, troubleshooting and solving...


  • Sydney, New South Wales, Australia Amazon (AWS) Full time

    About the RoleThis is a challenging opportunity to work as a Software Development Engineer Intern at Amazon (AWS), one of the leading companies in the industry. You will be part of a diverse team that is continuing to grow rapidly. This is the chance to join a dynamic environment where you can learn and grow.ResponsibilitiesDesign and code solutions to...


  • Sydney, New South Wales, Australia Zone IT Solutions Full time

    Job DescriptionWe are seeking a highly skilled Enterprise Data Modeller to join our team at Zone IT Solutions in Australia. As an Enterprise Data Modeller, you will be responsible for designing, implementing, and maintaining data models for our clients' data warehouse solutions.Key Responsibilities:Design and implement logical and physical data models for...

  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team, responsible for designing, building, and delivering enterprise-wide data ingestion, data integration, and data pipeline solutions using common programming languages such as Scala, Java, or Python in a Big Data and Data Warehouse platform.Key ResponsibilitiesDesign and...


  • Sydney, New South Wales, Australia Zone IT Solutions Full time

    We are seeking an experienced AWS Hadoop Data Engineer to join our team at Zone IT Solutions in Australia.About the RoleThis is a fantastic opportunity to leverage your expertise in designing and implementing data processing workflows on the AWS cloud platform.Key ResponsibilitiesDesign, build, and optimize data pipelines and processing frameworks on the AWS...


  • Sydney, New South Wales, Australia Amazon (AWS) Full time

    About the RoleThis is a Support Engineer, AWS Incident Response position with Amazon (AWS), a leading company in the AU region. The team is responsible for designing, planning, delivering, and operating all AWS global infrastructure. As a Support Engineer, you will be part of a diverse team of software, hardware, and network engineers, supply chain...


  • Sydney, New South Wales, Australia Amazon (AWS) Full time

    This is a challenging role for a Data Center IT Support Engineer, Data Centre Operations Specialist with one of the leading companies in the region, Amazon (AWS). The company is continuing to grow rapidly, and this is the chance to join right as the team expands.More About the Role at Amazon (AWS)## KEY RESPONSIBILITIESAs a Cloud Infrastructure Support...

  • Data Engineer

    1 day ago


    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    Drive Business Value with Data Engineering at Domain GroupWe are seeking a skilled Data Engineer to join our Data Decision Science team in Sydney. As a key member of our data department, you will play a critical role in building scalable data pipelines that power Australia's property market.About the RoleThis is an exciting opportunity to work with...

  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at the Commonwealth Bank of Australia. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and implement data pipelines using AWS Data Engineering Services such...

  • Big Data Engineer

    5 days ago


    Sydney, New South Wales, Australia Zone IT Solutions Full time

    We are seeking a highly skilled Big Data Engineer to join our team in Melbourne, Sydney, or India.Job Summary:Zone IT Solutions is a leading recruitment company specializing in Digital, ERP, and larger IT Services. We require an experienced Big Data Engineer to design and implement scalable big data solutions for our clients' analytical needs.About the...


  • Sydney, New South Wales, Australia Amazon (AWS) Full time

    About the RoleThis is a Software Development Engineer Internship role with Amazon (AWS), one of the leading companies in the technology industry. As an intern, you will have the opportunity to work on all phases of the software lifecycle, from design to deployment, alongside a diverse team of experienced engineers.ResponsibilitiesDesign and code right...


  • Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time

    About the RoleWe're seeking an experienced MLOPS Support Engineer to join our team at the Commonwealth Bank of Australia. As a key member of our analytics capabilities team, you'll be responsible for delivering high-quality data-driven platform solutions.What You'll DoSolve complex data-centric problems using the latest tech.Execute state-of-the-art ITIL...


  • Sydney, New South Wales, Australia Amazon (AWS) Full time

    This is a challenging role with Amazon (AWS) that involves working on the design, planning, delivery, and operation of all AWS global infrastructure. As a Support Engineer on the TechOps team, your mission is to reduce the duration, frequency, and impact of issues within the AWS and Amazon infrastructure. You will direct the resolution of high-visibility...

  • Cloud Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Bluefin Resources Full time

    Cloud Data Engineer - AWS SpecialistWe are seeking a seasoned Cloud Data Engineer to join our team in a data engineering role focused on building and managing secure, scalable data solutions.Key Responsibilities:Design, automate, and optimise data pipelines, datasets, and processes on AWS, ensuring high availability and performance.Use Infrastructure as Code...


  • Sydney, New South Wales, Australia Lion Full time

    At Lion, we're seeking a highly skilled AWS Data Engineering Director to lead our data platform initiatives. This role involves overseeing data ingestion, transformation, and provisioning to empower our Insights team. You will support and advance the platform's capabilities, foster a data-driven culture, and ensure adherence to data governance practices.Key...

  • Data Engineer

    3 days ago


    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    About UsWe shine a light on the property market, simplifying the journey for all involved. Our expertise and exclusive data drive change. At Domain Group, our data department leads the way in driving value across the organisation.The RoleAs a Senior Data Engineer, you'll play a key role in building data pipelines that power Australia's property market....

  • Senior Data Engineer

    4 weeks ago


    Sydney, New South Wales, Australia Macquarie Full time

    At Macquarie, we're looking for a skilled Data Engineer to join our Cyber Platforms team. This role is perfect for someone who enjoys working on complex data pipelines and ensuring data quality and accessibility for Engineers and Analysts.Key Responsibilities:Analyzing, designing, supporting, and executing multiple work-streams in consultation with key...


  • Sydney, New South Wales, Australia Lion Full time

    ​Data and Analytics Engineering Manager Job DescriptionAt Lion, we're on the hunt for talented individuals to join our team and help us drive growth and innovation. As a Data and Analytics Engineering Manager, you'll play a key role in leading our data engineering team to expand and optimize our data platform.Key Responsibilities:Lead and mentor a data...