Big Data Engineer

1 week ago

Sydney, New South Wales, Australia Pyramid Global Technologies Full time $100,000 - $150,000 per year


Job Description:

· years experience working in Data Engineering and Warehousing.

· years' experience integrating data into analytical platforms

· Experience in ingestion technologies (e.g. Sqoop, flume), processing technologies (Spark/Scala), and storage (e.g. HDFS, HBase, Hive)

· Experience in data profiling, source-target mappings, ETL development, SQL optimization, testing, and implementation

· Expertise in streaming frameworks (Kafka/Spark Streaming/Storm) essential

· Experience in building Spark Sql and Spark Data Frame API-based applications.

· Experience managing structured and unstructured data types

· Experience in requirements engineering, solution architecture, design, and development/deployment

· Experience in creating big data or analytics IT solution

· Track record of implementing databases and data access middleware and high-volume batch and (near) real-time processing


  • Big Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time $100,000 - $150,000 per year

    Job Description: · years experience working in Data Engineering and Warehousing.· years' experience integrating data into analytical platforms· Experience in ingestion technologies (e.g. Swoop, flume), processing technologies (Spark/Scala), and storage (e.g. HDFS, HBase, Hive)· Experience in data profiling, source-target mappings, ETL development, SQL...

  • Big Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Pyramid Global Technologies Full time $80,000 - $120,000 per year

    Job Description for Big Data Engineer:Primary Skills- Bigdata Hadoop, Hive, Spark, scala, SQLSecondary Skills- DW/ETL, Unix, Git, Bitbucket, ControlM- 3-5 years of experience in developing end to end bigdata pipeline- Must have experience in developing at least 1 bigdata project using hive, spark, scala- Thorough understanding of Hadoop and spark...

  • Big Data Lead Engineer

    1 week ago

    Sydney, New South Wales, Australia CareCone Group Full time $150,000 - $200,000 per year

    Role: Big Data Lead EngineerLocation: SydneyJob Description:Technical and Team Leadership:Provides technical direction and guidance to the engineering team.Ensures adherence to engineering standards and best practices.Participates in technical discussions and decision-making.Identifies and resolves technical challenges and issues.Conducts code reviews and...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Staff / Lead Data Engineer (AWS, Big Data)

    12 hours ago

    Sydney, New South Wales, Australia Commonwealth Bank Full time $120,000 - $180,000 per year

    Staff Data Engineer (AWS, Big Data)You are determined to stay ahead of the latest Cloud, Big Data and Data warehouse technologies.We're one of the largest and most advanced Data Engineering teams in the country.Together we can build state-of-the-art data solutions that power seamless experiences for millions of customers.Do work that matters:As a Staff Data...

  • Data Engineer Consultant

    1 week ago

    Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Whizdom Full time $100,000 - $120,000 per year

    Big Data Engineer – Python ScriptingAbout our client:Our client is a leader in professional services and consulting, providing a wide range of services including strategy, consulting, technology and systems integration, and operations to a range of clients across Government, Financial Services, Utilities and more.About the role:An opportunity exists for a...

  • Big Data Lead Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Tata Consultancy Services Full time $180,000 - $220,000 per year

    About the jobAbout TCS:Join Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us to combine a purpose-driven...

  • Data Engineer

    8 hours ago

    Sydney, New South Wales, Australia Kinetic Forge Full time $80,000 - $120,000 per year

    Data EngineerOverviewWe are seeking a skilled Data Engineer to design, build, and maintain data pipelines and infrastructure. The ideal candidate will ensure efficient data flow, optimize database performance, and support data analysis across the organization. You will work closely with data scientists, analysts, and engineering teams to deliver reliable and...

  • Senior Data Engineer

    1 week ago

    Sydney, New South Wales, Australia PayTech Nexus Full time $120,000 - $200,000 per year

    12 month contract opportunityStart - ASAPLocation - Sydney (hybrid)Opportunity to work with one of the largest and most advanced Data Engineering teams in the country As a Senior Data engineer with expertise in software development / programming and a passion for building data-driven solutions, you're ahead of trends and work at the forefront of Big Data and...