Hadoop Engineer

2 weeks ago


Sydney, New South Wales, Australia Zone IT Solutions Full time

We are currently seeking a skilled Hadoop Engineer. In this role, you will be responsible for designing, developing, and maintaining Hadoop infrastructure for our clients.

Requirements

  1. Strong experience with Hadoop ecosystem, including HDFS, MapReduce, Hive, Pig, Spark, and HBase.
  2. Proficiency in programming languages like Java, Scala, or Python.
  3. Hands-on experience with SQL and NoSQL databases.
  4. Experience in building and optimizing data pipelines and data architectures.
  5. Knowledge of distributed file systems and storage technologies such as HDFS, S3, or Azure Blob Storage.
  6. Experience with data ingestion, data processing, and data transformation.
  7. Understanding of data modeling and ETL processes.
  8. Experience with cloud platforms such as AWS or Azure is a plus.
  9. Strong problem-solving and troubleshooting skills.
  10. Excellent communication and collaboration abilities.
  11. Bachelor's degree in Computer Science, Engineering, or a related field.

Benefits

Zone IT Solutions is Australia based Recruitment company. We specialize in ERP and larger IT Services. We offer flexible, efficient and collaborative solutions to any organization that requires IT, experts. Our agile, agnostic and flexible solutions will help you source the IT Expertise you need. Our delivery Offices are in Melbourne, Sydney, Singapore, and India. If you are looking for new opportunities your profile at or contact us at

Also follow our LinkedIn page for new job opportunities and more.

Zone IT Solutions is an equal opportunity employer and our recruitment process focuses on essential skills and abilities. We welcome applicants from a diverse range of backgrounds, including Aboriginal and Torres Strait Islander peoples, people from culturally and linguistically diverse (CALD) backgrounds and people with disabilities.


  • Hadoop Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Zone It Solutions Full time

    We are looking for Hadoop Engineer for a role based in Sydney.You will be a part of a Global Consulting firm for one of their major projects.Technical: Implementation experience in Big Data Platform; preferably in Cloudera Hadoop platform Minimum 2 years of Development experience using Hadoop ecosystem tools & utilities: Map Reduce, Py Spark, Kafka, Sqoop,...


  • Sydney, New South Wales, Australia Virtusa Full time

    Data Engineer- Hadoop Big Data Platform Description Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc Ability to work independently and also contribute to overall architecture and...

  • Senior Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia https:www.bebeejoin Full time

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing Teradata Scala Python SQL Selenium Test automation Datawarehousing / BI experience Spark Hadoop / Big Data / HDFS Cloud migration experience AWS Cloud experience Primary Location Sydney, New South Wales, Australia Job Type Experienced Primary Skills Snowflake Years of...


  • Sydney, New South Wales, Australia Synpulse8 Full time

    Are you excited about transforming the way we bank by using the latest technology? We are tooWork with clients to solve business problems in fraud, compliance and financial crime and present project resultsManage, transform, and cleanse high volume dataAutomate data processing to enable on-going alerts on high-risk activityWork very closely with data...

  • Big Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Avance Consulting Full time

    Job OpportunityWe are in search of:Passionate individuals who are excited about developing cutting-edge data platforms for the bank.Enthusiastic team players who can both contribute to and learn from the diverse engineering talent within the team.Those ready to implement advanced coding techniques to deliver top-quality results, addressing key business goals...

  • Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Lendaly Pty Full time

    Improve upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required.ResponsibilitiesDesign, build, and maintain scalable data pipelines to collect, process, and store large volumes of structured and unstructured data from various...

  • Lead Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia ClearCompany Full time

    Lead Data Engineer (Dev Ops)Sydney, Australia$220,000 Including Super + BonusOverview:As a Lead Data Engineer reporting to our Engineering Manager, you will be responsible for building, implementing, and enhancing enterprise-scale data platforms.Working in a Dev Ops environment, you will have end-to-end accountability for designing, developing, deploying,...

  • Python Engineer

    2 weeks ago


    Sydney, New South Wales, Australia ClearCompany Full time

    Python Engineer Sydney $175,000 Inc Super + Bonus As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives.This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment.Key...

  • Lead Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Talenza Full time

    Lead Data Engineer (DevOps) Sydney, Australia $220,000 Including Super + Bonus Overview: As a Lead Data Engineer reporting to our Engineering Manager, you will be responsible for building, implementing, and enhancing enterprise-scale data platforms. Working in a DevOps environment, you will have end-to-end accountability for designing, developing,...


  • Sydney, New South Wales, Australia Efinancialcareers Ltd. Full time

    Omnia L2 ETL Senior Engineer Commonwealth Bank of Australia Sydney, Australia Omnia L2 ETL Senior Engineer Commonwealth Bank of Australia Sydney, Australia Posted 1 day ago Permanent Competitive You are going to be part of an interesting pipeline of high-visibility projects We are one of Australia's most advanced big data operations teams Together we will...

  • Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia ClearCompany Full time

    Data Engineer Sydney $175,000 Inc Super + BonusAs a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment.Key...

  • Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Talenza Full time

    Data Engineer Sydney $170,000 Inc Super + Bonus As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment. Key...

  • Python Engineer

    2 weeks ago


    Sydney, New South Wales, Australia ClearCompany Full time

    Python Engineer Sydney $175,000 Inc Super + BonusAs a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment.Key...

  • Python Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Talenza Full time

    Python Engineer Sydney $170,000 Inc Super + Bonus As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment. Key...


  • Sydney, New South Wales, Australia EFinancialCareers Ltd. Full time

    Principal Data Engineer Commonwealth Bank of Australia Sydney, Australia Principal Data Engineer Commonwealth Bank of Australia Sydney, Australia Posted 1 day ago Permanent Competitive Principal Data Engineer Principal Data Engineer You are determined to stay ahead of the latest Big Data, Ab Initio and Datawarehouse technologies We're one of the largest and...


  • Sydney, New South Wales, Australia eFinancialCareers Ltd. Full time

    Omnia L2 ETL Senior Engineer Commonwealth Bank of Australia Sydney, Australia Omnia L2 ETL Senior Engineer Commonwealth Bank of Australia Sydney, Australia Posted 1 day ago Permanent Competitive You are going to be part of an interesting pipeline of high-visibility projectsWe are one of Australia's most advanced big data operations teamsTogether we will...

  • Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Chrysalis Software Solutions Pty Full time

    Sydney, Australia | Posted on 04/25/2021 As a digital transformation company, we support businesses in enhancing both their operations and customer experiences to encourage growth and development within the digital realm. We guide organizations in understanding relevant trends and benchmark their digital capabilities against best practices and competitors....

  • Big Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Zone IT Solutions Full time

    We are currently seeking a talented and experienced Big Data Engineer. You will have the opportunity to work on cutting-edge projects and utilize your skills in big data technologies. RequirementsPassionate about building next-generation data platforms across the bank Enthusiastic, be able to contribute and learn from wider engineering talent in the team...

  • Staff Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia eFinancialCareers Ltd. Full time

    Staff Data Engineer Commonwealth Bank of Australia Sydney, Australia Staff Data Engineer Commonwealth Bank of Australia Sydney, Australia Posted 2 days ago Permanent Competitive You are determined to stay ahead of the latest Big Data, Ab Initio and Datawarehouse technologiesWe're one of the largest and most advanced Data Engineering teams in the...

  • Data Engineer

    2 weeks ago


    Sydney, New South Wales, Australia Crypto Recruit Full time

    Develop and oversee optimal data pipeline architecture across all blockchain data products: nodes, token transactions, gaming, and marketplace.The company is an Ethereum Layer 2 scaling solution, built to empower digital assets, NFT, and blockchain gaming.Our mission is to empower digital asset ownership for people and businesses.If you get excited by the...