![Avance Consulting](https://media.trabajo.org/img/noimg.jpg)
Big Data Engineer
4 weeks ago
Job Description
Looking for:
Passionate about building next generation data platforms across the bank.
Enthusiastic, be able to contribute and learn from wider engineering talent in the team.
Ready to execute state-of-the-art coding practices, driving high quality outcomes to solve core business objectives and minimise risks.
Capable to create both technology blueprints and engineering roadmaps, for a multi- year data transformational journey.
Constantly thinking outside the box and breaking boundaries to solve complex data problems.
Must Have:
Experience in building Data pipelines.
Hadoop / Teradata platform, using Spark , TCF and various ETL frameworks.
Strong scripting knowledge in Java or Python.
Experience in off the shelf ETL tools preferably AbInitio.
Exposure to AWS Cloud platform and Snowflake is desirable .
-
Big Data Engineer
6 days ago
Sydney, New South Wales, Australia Pyramid Global Technologies Full timeAbout the job Big Data Engineer Job Description:· 5+ years experience working in Data Engineering and Warehousing. · 3 -5 years' experience integrating data into analytical platforms · Experience in ingestion technologies (e.g. Sqoop, flume), processing technologies (Spark/Scala), and storage (e.g. HDFS, HBase, Hive) · Experience in data profiling,...
-
Big Data Engineer
5 days ago
Sydney, New South Wales, Australia Zone IT Solutions Full timeWe are currently seeking a talented and experienced Big Data Engineer. You will have the opportunity to work on cutting-edge projects and utilize your skills in big data technologies. RequirementsPassionate about building next-generation data platforms across the bank Enthusiastic, be able to contribute and learn from wider engineering talent in the team...
-
Azure Big Data
6 days ago
Sydney, New South Wales, Australia Cognizant Full timeDo you have Azure experience and are you seeking a new job? Cognizant is recruiting an Azure Big Data Engineer.To apply for this Azure Big Data Engineer role, your soft skills, expertise and experience should include:Working knowledge in Azure services ADF, ADLS, Event Hub, cosmosDB, Azure Databricks Knowledge of CICD – Git / Bitbucket, Jenkins / Bamboo...
-
Big Data Engineer
5 days ago
Sydney, New South Wales, Australia Avance Consulting Full timeJob OpportunityWe are in search of:Passionate individuals who are excited about developing cutting-edge data platforms for the bank.Enthusiastic team players who can both contribute to and learn from the diverse engineering talent within the team.Those ready to implement advanced coding techniques to deliver top-quality results, addressing key business goals...
-
Machine Learning Engineer
2 months ago
Sydney, Australia TikTok Full timeAbout the team Be part of TikTok's groundbreaking Data Application Team within the Video Cloud Infrastructure division, where we empower our Live CDN and ultra-edge CDN service teams to revolutionize video on demand and video streaming through data-driven insights and cutting-edge algorithms. By harnessing the vast log data generated by our CDNs, we...
-
Machine Learning Engineer
3 weeks ago
Sydney, Australia TikTok Full timeAbout the team Be part of TikTok's groundbreaking Data Application Team within the Video Cloud Infrastructure division, where we empower our Live CDN and ultra-edge CDN service teams to revolutionize video on demand and video streaming through data-driven insights and cutting-edge algorithms. By harnessing the vast log data generated by our CDNs, we...
-
Data Engineer- Hadoop Big Data Platform
2 months ago
Sydney, Australia Virtusa Full timeData Engineer- Hadoop Big Data Platform - 104329 Description Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc Ability to work independently and also contribute to overall...
-
Data Engineer- Hadoop Big Data Platform
3 weeks ago
Sydney, Australia Virtusa Full timeData Engineer- Hadoop Big Data Platform - 104329 Description Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc Ability to work independently and also contribute to overall...
-
Data Engineer- Hadoop Big Data Platform
6 days ago
Sydney, New South Wales, Australia Virtusa Full timeData Engineer- Hadoop Big Data Platform Description Implementation experience in BigData Platform ; preferably in Cloudera Hadoop platform Minimum 2 years of Development experience using Hadoop eco system tools & utilities: MapReduce, Spark, Kafka, Sqoop, Impala, Hive etc Ability to work independently and also contribute to overall architecture and...
-
Azure Big Data
2 weeks ago
Sydney, Australia Cognizant Full timeDo you have Azure experience and are you seeking a new job? Cognizant is recruiting an Azure Big Data Engineer. - Working knowledge in Azure services ADF, ADLS, Event Hub, cosmosDB, Azure Databricks - Knowledge of CICD - Git / Bitbucket, Jenkins / Bamboo - Have experience in executing Hive/Impala SQLs - Sound knowledge on Spark Query tuning and performance...
-
Big Data Intern
3 weeks ago
Sydney, Australia Openmesh Network Full time**(Data Processing and Analytics)** We are inviting selected students (BA, MS) in Data Science to be part of pioneering cloud, data, AI and web3 space. You will gain valuable experience through working on a cutting edge solution for processing and analyzing large datasets together with big data experts and Openmesh senior engineers. This internship can be...
-
Big Data DevOps Eng
2 months ago
Sydney, Australia Ontrack Systems Full time**Skills Required**: Resource should be an experienced Big Data DevOps engineer Demonstrated knowledge and experience in Bigdata Cloudera Experience with CI/CD Exposure in DevOps/DataOps in Azure (good to have) Knowledge and experience in Apache Airflow (good to have) Excellent troubleshooting and debugging skills Ability to work independently as well...
-
Azure Big Data
5 days ago
Sydney, New South Wales, Australia Cognizant Full timeDo you have Azure experience and are you seeking a new job? Cognizant is recruiting an Azure Big Data Engineer. Working knowledge in Azure services ADF, ADLS, Event Hub, cosmosDB, Azure Databricks Knowledge of CICD Git / Bitbucket, Jenkins / Bamboo Have experience in executing Hive/Impala SQLs Sound knowledge on Spark Query tuning and performance...
-
Data Engineer
3 weeks ago
Sydney, Australia Virtusa Full timeData Engineer - CREQ186610 Description Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora Primary Location Sydney, New South Wales,...
-
Data Engineer
2 months ago
Sydney, Australia Virtusa Full timeData Engineer - CREQ186610 Description Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora Primary Location Sydney, New South Wales,...
-
Big Data DevOps Eng
6 days ago
Sydney, New South Wales, Australia Ontrack Systems Full timeSkills Required:Resource should be an experienced Big Data DevOps engineerDemonstrated knowledge and experience in Bigdata ClouderaExperience with CI/CDExposure in DevOps/DataOps in Azure (good to have)Knowledge and experience in Apache Airflow (good to have)Excellent troubleshooting and debugging skillsAbility to work independently as well as with...
-
Data Engineer
5 days ago
Sydney, New South Wales, Australia Practiv Limited Full timeAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...
-
Data Engineer
3 weeks ago
Sydney, Australia Practiv Full timeAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...
-
Data Engineer
2 months ago
Sydney, Australia Practiv Full timeAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...
-
Data Engineer
5 days ago
Sydney, New South Wales, Australia Practiv Full timeAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...