Data engineer- Sydney
4 weeks ago
Job Description
Hands on experience in Batch (must) and Streaming (preferable) processing on Cloudera data platform tool-stack:
Must have: Hadoop, Spark, HIVE, Oozie and Python/Pyspark as the programming language
Preferable: Scala, Hbase, Java, Shell scripting
Min 3 years of hands-on project experience on Big Data platform – preferable Cloudera/Hortonworks
Min 2 years of Cloud experience – preferable on Azure
Min 2 end to end data lake project delivery experience
A very clear understanding of data warehousing processes, methodologies and supporting capabilities
Be able to propose solutions and clearly articulate pros and cons of various technologies and platforms in the Big Data world
To be able to benchmark systems, analyse system bottlenecks.
To be able to document use cases, solutions, and recommendations.
To have excellent written and verbal communication skills
To be able to perform detailed analysis of business problems and technical environments and use this in designing the solution
To be able to work in teams, as a big data environment is developed in a team of employees with different disciplines
To be able to work in a fast-paced agile development environment.
Job Types: Full-time, Permanent
Salary: $91,383.00 – $164,767.00 per year
-
Data Engineer
4 weeks ago
NSW - Sydney - City & Inner West, Australia LeadersIT Services Pty Ltd Full timeWe are seeking a Data Engineer to design, optimise, and maintain enterprise-grade data pipelines, automation frameworks, and governance processes. The successful candidate will play a key role in enabling marketing data-driven customer engagement by building scalable data solutions, improving data quality, and ensuring compliance across multiple brands. This...
-
Data Engineer
3 weeks ago
NSW - Sydney - City & Inner West, Australia NEXUS DIVISION PTY LTD Full timePay: A$100,000.00 - A$140,000.00 per year Job description: Job Title: Data Engineer (ANZSCO: 261111) Location: Sydney Melbourne and Brisbane (Hybrid Options Available) Employment Type: Full-Time or Contract Pay: AU $100 000 – $140 000 per year (or equivalent contract rate) About the Role Nexus Division is seeking an accomplished Senior Data Engineer...
-
Data Engineer
7 days ago
Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...
-
Senior Data Engineer
7 days ago
Inner West, Australia NSW Government Full time $120,000 - $180,000 per yearTwo ongoing, full-time rolesLocated in Eveleigh with flexible working arrangements availableSalary: Clerk Grade 11/12 with base salary ranging from $149,739 to $173,174 per annum, plus employer's contribution to superannuation and annual leave loadingThe NSW Department of Education's Information Technology Directorate (ITD) is transforming. There is an...
-
Data Analyst
6 days ago
Sydney, Australia The Data Foundry Full timeCompany Description We are a customer-obsessed, “one stop shop” for all things data-related. We are deliberately narrow in our focus areas but we go deep in each of them. We provide solutions, services and training in the **data strategy, data governance, data security, data management, data classification, data wrangling, data lake, data analytics,...
-
Data Engineer
2 weeks ago
Sydney NSW, Australia INGRITY Full time $100,000 - $150,000 per yearLocation: SydneyEmployment Type: ContractExperience Level: 2–3 yearsAbout the Role:We are seeking a motivated Data Engineer with 2–3 years of experience to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will work closely with BI developers, and business teams to ensure high-quality, reliable data for analytics...
-
Data Engineer Consultant
6 days ago
Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...
-
Only 24h Left! Project Engineer, Sydney
3 weeks ago
Council of the City of Sydney, Australia Sydney Metro Full timeUpdate your details, view your application and progress. Project Engineer, Sydney (Royal Prince Alfred Hospital Redevelopment) At CPB Contractors, we know what it takes to construct a better future. Our track record speaks for itself – more than 90 years’ experience in transforming communities to help people live, work and move better. Today we are...
-
Lead Data Engineer
7 days ago
Sydney NSW, Australia INGRITY Full time $120,000 - $180,000 per yearLocation: SydneyJob Type: ContractWe are looking for an experienced Lead Data Engineer with deep hands-on expertise in Data and ETL to lead strategic initiatives and transform our data platform. You will leverage your technical leadership, strategic thinking, and problem-solving skills to guide a team of engineers, enhance platform efficiency through AI and...
-
GCP Data Engineer
2 days ago
Sydney NSW, Australia Cognizant Technology Solutions Full time $100,000 - $150,000 per yearPosition Summary:Looking for GCP Data Engineer to join their dynamic data and analytics team in Sydney. The successful candidate will play a pivotal role in designing, developing, and optimizing scalable data solutions on Google Cloud Platform (GCP) to support business intelligence, analytics, and digital transformation initiatives.Mandatory Skills:6+ years...