Data engineer- Sydney

5 days ago

NSW Sydney City amp Inner West, Australia Centelon Pty Ltd Full time

Job Description


Hands on experience in Batch (must) and Streaming (preferable) processing on Cloudera data platform tool-stack:
Must have: Hadoop, Spark, HIVE, Oozie and Python/Pyspark as the programming language
Preferable: Scala, Hbase, Java, Shell scripting



Min 3 years of hands-on project experience on Big Data platform – preferable Cloudera/Hortonworks
Min 2 years of Cloud experience – preferable on Azure
Min 2 end to end data lake project delivery experience
A very clear understanding of data warehousing processes, methodologies and supporting capabilities
Be able to propose solutions and clearly articulate pros and cons of various technologies and platforms in the Big Data world
To be able to benchmark systems, analyse system bottlenecks.
To be able to document use cases, solutions, and recommendations.
To have excellent written and verbal communication skills
To be able to perform detailed analysis of business problems and technical environments and use this in designing the solution
To be able to work in teams, as a big data environment is developed in a team of employees with different disciplines
To be able to work in a fast-paced agile development environment.


Job Types: Full-time, Permanent

Salary: $91,383.00 – $164,767.00 per year

  • Data Engineer

    5 days ago

    NSW - Sydney - City & Inner West, Australia LeadersIT Services Pty Ltd Full time

    We are seeking a Data Engineer to design, optimise, and maintain enterprise-grade data pipelines, automation frameworks, and governance processes. The successful candidate will play a key role in enabling marketing data-driven customer engagement by building scalable data solutions, improving data quality, and ensuring compliance across multiple brands. This...

  • Data Engineer

    2 days ago

    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    5 days ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Senior Data Engineer

    5 days ago

    Inner West, Australia NSW Government Full time $120,000 - $180,000 per year

    Two ongoing, full-time rolesLocated in Eveleigh with flexible working arrangements availableSalary: Clerk Grade 11/12 with base salary ranging from $149,739 to $173,174 per annum, plus employer's contribution to superannuation and annual leave loadingThe NSW Department of Education's Information Technology Directorate (ITD) is transforming. There is an...

  • Data Analyst

    1 week ago

    Sydney, Australia The Data Foundry Full time

    Company Description We are a customer-obsessed, “one stop shop” for all things data-related. We are deliberately narrow in our focus areas but we go deep in each of them. We provide solutions, services and training in the **data strategy, data governance, data security, data management, data classification, data wrangling, data lake, data analytics,...

  • Data Analyst

    2 weeks ago

    Sydney, Australia The Data Foundry Full time

    Company Description We are a customer-obsessed, “one stop shop” for all things data-related. We are deliberately narrow in our focus areas but we go deep in each of them. We provide solutions, services and training in the **data strategy, data governance, data security, data management, data classification, data wrangling, data lake, data analytics,...

  • Data Engineer

    1 week ago

    Sydney NSW, Australia INGRITY Full time $100,000 - $150,000 per year

    Location: SydneyEmployment Type: ContractExperience Level: 2–3 yearsAbout the Role:We are seeking a motivated Data Engineer with 2–3 years of experience to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will work closely with BI developers, and business teams to ensure high-quality, reliable data for analytics...

  • ▷ Immediate Start: Mechanical Engineering Draftsperson

    4 weeks ago

    NSW - Sydney - City & Inner West, Australia DARA Contractors Full time

    Mechanical Engineering Draftsperson – DARA Contractors Pty Ltd ?? Sydney, NSW | ?? Engineering Drafting (Mechanical Engineering) ?? Full-time | Minimum 38 hours per week ?? $78,000 – $85,000 per year (depending on experience) Company Description DARA Contractors is a specialist provider of piling and ground engineering solutions. With experience across...

  • Data Engineer Consultant

    4 days ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Data Engineer

    2 weeks ago

    Council of the City of Sydney, Australia GrainCorp Full time

    Overview GrainCorp is currently seeking a Data Engineer to join a motivated and collaborative team delivering data, infrastructure, and system activities to support advanced analytic use cases. You’ll have the opportunity to work from multiple exciting AI and IoT projects and be trained by experts who’ve been in this space for...