Senior Data Engineer
2 hours ago
12 month contract opportunityStart - ASAPLocation - Sydney (hybrid)Opportunity to work with one of the largest and most advanced Data Engineering teams in the country As a Senior Data engineer with expertise in software development / programming and a passion for building data-driven solutions, you're ahead of trends and work at the forefront of Big Data and Data warehouse technologies.We are seeking people who are:Passionate about building next generation data platforms and data pipeline solution across the bank.Ready to execute state-of-the-art coding practices, driving high quality outcomes to solve core business objectives and minimise risks.Capable to create both technology blueprints and engineering roadmaps, for a multi- year data transformational journey.Are experienced in providing data driven solutions that source data from various enterprise data platform into Cloudera Hadoop Big Data environment, using technologies like Spark, MapReduce, Hive, Sqoop, Kafka; transform and process the source data to produce dataassets; and transform and egression to other data platforms like Teradata or RDBMS system.Are experienced in building effective and efficient Big Data and Data Warehouse frameworks, capabilities, and features, using common programming language (Scala, Java, or Python), with proper data quality assurance and security controls.Are experienced in designing, building, and delivering optimised enterprise-wide data ingestion, data integration and data pipeline solutions for Big Data and Data warehouse platforms.Are confident in building group data products or data assets from scratch, by integrating large sets of data derived from hundreds of internal and external sources.Can lead and mentor other data engineers in a project work or initiative.Have experience and responsible for data security and data management.Technical skillsExperience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform. Preferably with at least 5+ years of hands-on experience in a Data Engineering role.Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing. Preferably with at least 5+ years of hands-on experience.Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.Proficient in SQL scripting, writing complex SQLs for building data pipelines.Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.Experience in working in Agile teams, including working closely with internal business stakeholders.Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus.Certification on Cloudera CDP, Hadoop, Spark, Teradata, AWS, Ab Initio is a plus.Experience in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.) is a plus.Experience in AWS technology (EMR, Redshift, DocumentDB, S3, etc.) is a plus.
-
Data Engineer
2 days ago
Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...
-
Senior Data Engineer
5 hours ago
Sydney, New South Wales, Australia Coforge Full time $120,000 - $180,000 per yearRole:Senior Data EngineerJob Type: Full time/ContractLocation: SydneyExperience: 8+ yearsThe PositionThe Senior Data Engineer role is responsible for building, maintaining, and optimizing scalable data pipelines and platforms that enable data-driven decision-making. As a member of the ICT team, you will contribute to testing activities throughout the project...
-
Senior Data Engineer
2 weeks ago
Sydney, New South Wales, Australia Talenza Full time $90,000 - $105,000 per yearRole: Senior Data EngineerDay Rate: $1150 - $1250 incl. SuperContract Length: 6-monthsLocation: Sydney CBD/WFH FlexWe're looking for a Senior Data Engineer to join a large-scale digital transformation program. You'll play a pivotal role in designing, building, and optimising data pipelines and platform components across a modern cloud-based ecosystem,...
-
Senior Data Engineer
6 days ago
Sydney, New South Wales, Australia iVEGA Consulting Full time $100,000 - $180,000 per yearWe have multiple data engineer requirements: Senior Data Engineer, Staff Data Engineer, Lead Data EngineerJD 1: Senior Data Eng position here is the skills summary (the AWS data stack is must have)Sound understanding of Data modelling conceptsStrong knowledge of SQLAWS Data Stack: S3,RDS, Redshift,Iceberg and Glue (proficient)Programming languages:...
-
Senior Data Engineer
2 weeks ago
Sydney, New South Wales, Australia Simplyai Full time $80,000 - $140,000 per yearAbout the roleSimplyai' is seeking an experienced Senior Data Engineer to join our growing team. In this full-time position based in Sydney, NSW, you will be responsible for designing, building and maintaining scalable data pipelines and infrastructure on the Snowflake platform. This is a strategic role that will have a significant impact on the company's...
-
Senior Software Engineer
2 hours ago
Sydney, New South Wales, Australia Seer Data & Analytics Full time $120,000 - $180,000 per yearSeer Data & Analytics is an Australian purpose-led technology company turning data and AI into action for a better world. Our mission is totransparently and securely connect andprovide access to data from the source toempower leaders to make better decisions.Our values areFairness firstRespect and protectShared groundPioneering spiritTrust by...
-
Data Engineer Consultant
7 hours ago
Sydney, New South Wales, Australia NTT DATA, Inc. Full time $80,000 - $140,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...
-
Senior Data Engineer
2 weeks ago
Sydney, New South Wales, Australia MIP Australia Full time $120,000 - $180,000 per yearSenior Data Engineer (Snowflake/Fabric) – ConsultingLocation:Sydney (hybrid)Employment:Full-timeCompany:MIP – The Data CompanyAbout the roleWe're growing our data engineering practice and looking for aSenior Data Engineerwho can design, build, and ship modern data platforms,Snowflake (priority)andMicrosoft Fabric,withDatabricksas a nice-to-have. You'll...
-
Senior Data Engineer
2 days ago
Sydney, New South Wales, Australia Long Resources Ltd Full time $120,000 - $180,000 per yearOur client an Australian software company known for creating collaboration and productivity tools for teams is looking for a senior software engineer specialising in optimising large-scale data processing systems (batch and streaming) and moving billions of billing records daily. Led by the FinOps Principal Tech Lead, you will collaborate with two other...
-
Senior Data Engineer
2 days ago
Sydney, New South Wales, Australia Neara Full time $120,000 - $180,000 per yearImagine preventing wildfires before they start, or ensuring power grids stay resilient during extreme weather. That's the real-world impact we create every day at Neara.We build 3D physics-enabled digital twins of critical infrastructure networks that help utilities and infrastructure companies run scenarios, assess risks, and make smarter decisions that...
