Data Engineering Expert

6 days ago

Sydney, New South Wales, Australia beBeeDataEngineering Full time $180,000 - $240,000
Job Title: Data Engineering Expert

We are seeking an experienced Data Engineering Expert to join our team.

  • This is a senior-level position that requires expertise in designing, building, and delivering large-scale data ingestion, integration, and pipeline solutions.
  • The ideal candidate will have experience working with big data platforms, including Hadoop, Spark, and AWS Cloud technology.
Key Responsibilities:
  • Design, build, and deliver enterprise-wide data ingestion, data integration, and data pipeline solutions using common programming languages (Scala, Java, or Python).
  • Experience in building data solutions in Hadoop platforms, using Spark, MapReduce, Sqoop, Kafka, and various ETL frameworks for distributed data storage and processing.
  • Build data solutions using AWS Cloud technology (EMR, Glue, Iceberg, Kinesis, MSK / Kafka, Redshift / PostgresSQL, DocumentDB / MongoDB, S3, etc.).
  • Produce conceptual, logical, and physical data models using data modelling techniques such as Data Vault, Kimball, 3NF, etc., and demonstrate expertise in design patterns (FSLDM, IBM IFW DW).
Requirements:
  • Confident in building group data products or data assets from scratch by integrating large sets of data derived from hundreds of internal and external sources.
  • Collaborate, co-create, and contribute to existing Data Engineering practices in the team.
  • Lead and mentor other engineers in Agile teams delivering project work or initiative.
  • Have experience and responsible for data design, data security, and data management.
  • Natural drive to educate, communicate, and coordinate with different internal stakeholders and consultants.
Technical Skills:
  • Experience in designing, building, and delivering enterprise-wide data ingestion, data integration, and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform.
  • Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.
  • Proficient in SQL scripting, writing complex SQLs for building data pipelines.

We use a broad range of tools, languages, and frameworks. Experience or exposure with some of these (or equivalents) will set you up for success in this team. If this sounds like the role for you, we would love to hear from you.

  • Data Engineer Consultant

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Engineer Consultant

    4 weeks ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time

    Join to apply for the Data Engineer Consultant role at NTT DATA, Inc.3 days ago Be among the first 25 applicantsJoin to apply for the Data Engineer Consultant role at NTT DATA, Inc.Get AI-powered advice on this job and more exclusive features.Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineer

    7 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Data Engineering Expert

    7 days ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $170,000 - $200,000

    Job Title:Data Engineering ExpertJob DescriptionWe are seeking a highly skilled Data Engineering Expert to join our team. The ideal candidate will have extensive experience in designing scalable data pipelines and building modern, high-performance data platforms.Main Responsibilities:Designing and implementing efficient data pipelines using Python and...

  • Data Engineering Expert

    7 days ago

    Sydney, New South Wales, Australia beBeeEngineering Full time $120,000 - $180,000

    Senior Data EngineerWe're seeking an experienced Data Engineering Expert to drive the development and implementation of large-scale data architectures and systems using AWS cloud-based services. As a key member of our engineering team, you'll have the opportunity to work on strategic data initiatives that drive business value.Design, develop, and maintain...

  • Data Engineering Expert

    7 days ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $90,000 - $115,000

    Job OpportunityWe are seeking a highly skilled Data Engineering Expert to join our team.The selected candidate will work closely with the data infrastructure team to design, develop, and maintain scalable data pipelines and architectures.Key responsibilities include transforming business requirements into working solutions, fostering collaboration among team...

  • Data Engineering Expert

    5 days ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $100,000 - $110,000

    Job Title: Data Engineering ExpertWe are seeking a skilled Data Engineer to design, build, and optimize data integration solutions in a Teradata environment.Key Responsibilities:Develop ETL/ELT jobs for data warehousing and dimensional modeling.Enhance data models and marts within a large-scale enterprise data warehouse.Support data provisioning for...