Big Data Engineer

4 weeks ago


Sydney, Australia Avance Consulting Full time

Job Description

Looking for:

  • Passionate about building next generation data platforms across the bank.

  • Enthusiastic, be able to contribute and learn from wider engineering talent in the team.

  • Ready to execute state-of-the-art coding practices, driving high quality outcomes to solve core business objectives and minimise risks.

  • Capable to create both technology blueprints and engineering roadmaps, for a multi- year data transformational journey.

  • Constantly thinking outside the box and breaking boundaries to solve complex data problems.

Must Have:

  • Experience in building Data pipelines.

  • Hadoop / Teradata  platform, using Spark , TCF and various ETL frameworks.

  • Strong scripting knowledge in Java or Python.

  • Experience in off the shelf ETL tools preferably AbInitio.

  • Exposure to AWS Cloud platform and Snowflake is desirable .


  • Big Data Engineer

    6 days ago


    Sydney, New South Wales, Australia Pyramid Global Technologies Full time

    About the job Big Data Engineer Job Description:· 5+ years experience working in Data Engineering and Warehousing. · 3 -5 years' experience integrating data into analytical platforms · Experience in ingestion technologies (e.g. Sqoop, flume), processing technologies (Spark/Scala), and storage (e.g. HDFS, HBase, Hive) · Experience in data profiling,...

  • Big Data Engineer

    5 days ago


    Sydney, New South Wales, Australia Zone IT Solutions Full time

    We are currently seeking a talented and experienced Big Data Engineer. You will have the opportunity to work on cutting-edge projects and utilize your skills in big data technologies. RequirementsPassionate about building next-generation data platforms across the bank Enthusiastic, be able to contribute and learn from wider engineering talent in the team...

  • Azure Big Data

    6 days ago


    Sydney, New South Wales, Australia Cognizant Full time

    Do you have Azure experience and are you seeking a new job? Cognizant is recruiting an Azure Big Data Engineer.To apply for this Azure Big Data Engineer role, your soft skills, expertise and experience should include:Working knowledge in Azure services ADF, ADLS, Event Hub, cosmosDB, Azure Databricks Knowledge of CICD – Git / Bitbucket, Jenkins / Bamboo...

  • Big Data Engineer

    5 days ago


    Sydney, New South Wales, Australia Avance Consulting Full time

    Job OpportunityWe are in search of:Passionate individuals who are excited about developing cutting-edge data platforms for the bank.Enthusiastic team players who can both contribute to and learn from the diverse engineering talent within the team.Those ready to implement advanced coding techniques to deliver top-quality results, addressing key business goals...


  • Sydney, Australia TikTok Full time

    About the team Be part of TikTok's groundbreaking Data Application Team within the Video Cloud Infrastructure division, where we empower our Live CDN and ultra-edge CDN service teams to revolutionize video on demand and video streaming through data-driven insights and cutting-edge algorithms. By harnessing the vast log data generated by our CDNs, we...


  • Sydney, Australia TikTok Full time

    About the team Be part of TikTok's groundbreaking Data Application Team within the Video Cloud Infrastructure division, where we empower our Live CDN and ultra-edge CDN service teams to revolutionize video on demand and video streaming through data-driven insights and cutting-edge algorithms. By harnessing the vast log data generated by our CDNs, we...


  • Sydney, Australia Virtusa Full time

    Data Engineer- Hadoop Big Data Platform - 104329 Description Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc Ability to work independently and also contribute to overall...


  • Sydney, Australia Virtusa Full time

    Data Engineer- Hadoop Big Data Platform - 104329 Description Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc Ability to work independently and also contribute to overall...


  • Sydney, New South Wales, Australia Virtusa Full time

    Data Engineer- Hadoop Big Data Platform Description Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc Ability to work independently and also contribute to overall architecture and...

  • Azure Big Data

    2 weeks ago


    Sydney, Australia Cognizant Full time

    Do you have Azure experience and are you seeking a new job? Cognizant is recruiting an Azure Big Data Engineer. - Working knowledge in Azure services ADF, ADLS, Event Hub, cosmosDB, Azure Databricks - Knowledge of CICD - Git / Bitbucket, Jenkins / Bamboo - Have experience in executing Hive/Impala SQLs - Sound knowledge on Spark Query tuning and performance...

  • Big Data Intern

    3 weeks ago


    Sydney, Australia Openmesh Network Full time

    **(Data Processing and Analytics)** We are inviting selected students (BA, MS) in Data Science to be part of pioneering cloud, data, AI and web3 space. You will gain valuable experience through working on a cutting edge solution for processing and analyzing large datasets together with big data experts and Openmesh senior engineers. This internship can be...

  • Big Data DevOps Eng

    2 months ago


    Sydney, Australia Ontrack Systems Full time

    **Skills Required**: Resource should be an experienced Big Data DevOps engineer Demonstrated knowledge and experience in Bigdata Cloudera Experience with CI/CD Exposure in DevOps/DataOps in Azure (good to have) Knowledge and experience in Apache Airflow (good to have) Excellent troubleshooting and debugging skills Ability to work independently as well...

  • Azure Big Data

    5 days ago


    Sydney, New South Wales, Australia Cognizant Full time

    Do you have Azure experience and are you seeking a new job? Cognizant is recruiting an Azure Big Data Engineer. Working knowledge in Azure services ADF, ADLS, Event Hub, cosmosDB, Azure Databricks Knowledge of CICD Git / Bitbucket, Jenkins / Bamboo Have experience in executing Hive/Impala SQLs Sound knowledge on Spark Query tuning and performance...

  • Data Engineer

    3 weeks ago


    Sydney, Australia Virtusa Full time

    Data Engineer - CREQ186610 Description Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora Primary Location Sydney, New South Wales,...

  • Data Engineer

    2 months ago


    Sydney, Australia Virtusa Full time

    Data Engineer - CREQ186610 Description Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora Primary Location Sydney, New South Wales,...

  • Big Data DevOps Eng

    6 days ago


    Sydney, New South Wales, Australia Ontrack Systems Full time

    Skills Required:Resource should be an experienced Big Data DevOps engineerDemonstrated knowledge and experience in Bigdata ClouderaExperience with CI/CDExposure in DevOps/DataOps in Azure (good to have)Knowledge and experience in Apache Airflow (good to have)Excellent troubleshooting and debugging skillsAbility to work independently as well as with...

  • Data Engineer

    5 days ago


    Sydney, New South Wales, Australia Practiv Limited Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    3 weeks ago


    Sydney, Australia Practiv Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    2 months ago


    Sydney, Australia Practiv Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    5 days ago


    Sydney, New South Wales, Australia Practiv Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...