Data Engineers

2 weeks ago


Perth, Western Australia Softtest pays pty ltd Full time

Australian Citizens residing in Australia only respond.

Must be able to obtain Baseline.

Overview

At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia.

Role Responsibilities and Duties:

  • Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack.
  • Develop scalable architecture practices for pipeline designs.
  • Lead data migration and integration for critical change programs.
  • Ensure data integrity and align engineering tasks with program objectives.
  • Mentor team members and drive new data engineering practices adoption.
  • Monitor and improve data service performance and costs.
  • Maintain documentation and adhere to data governance policies.
  • Research and innovate within the Azure data engineering field.

Qualifications/Experience:

  • Bachelors degree in computer science, Engineering, or a related field.
  • Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate.
  • 3+ years of experience in data engineering with a focus on Azure services.
  • Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines.
  • Demonstrated ability to design and implement scalable data architectures.
  • Experience in data migration and managing large-scale data pipelines.
  • Familiarity with DevOps practices and tools within the Azure ecosystem.
  • Strong technical skills in SQL, Python, and R
  • Proficiency in data modelling including reuse and scalability patterns
  • Knowledge of Azure Monitor, Azure Security, and compliance frameworks.
  • Ability to work with cross-functional teams and lead technical projects.
  • Experience building data profiling, data cleansing and data engineering frameworks.
  • Address Each Selection criteria to support your application(one page summary)

Address Each Selection criteria to support your application(one page summary)

Essential criteria

1. The extent to which the candidate has the required level of experience and qualifications to deliver against the role description.

Desirable criteria

  1. The extent to which the proposed fees represent value for money to the CER.

  • Senior Data Engineer

    2 weeks ago


    Perth, Western Australia Data Spree GmbH Full time

    Select how often (in days) to receive an alert: Fortescue is both a proud West Australian company and a global green solutions business. We are recognised for our culture, innovation and industry-leading development of infrastructure, mining assets and green energy initiatives. Work Location - Redcliffe WA (Relocation to Perth provided) Roster - Monday...

  • Senior Data Engineer

    2 weeks ago


    Perth, Western Australia Data Divers Pty Full time

    About DataDivers is a dedicated consultancy for all things data and analytics. Our expertise spans data strategy, data platforms, DataOps, advanced analytics, data science, and building a data culture in our clients' organisations. We are exceptional problem solvers who turn data into real business insights.As a results-driven organisation, we are committed...

  • data engineer

    2 weeks ago


    Perth, Western Australia Opus Recruitment Solutions Full time

    ApplyData Engineer Perth, Australia Permanent$ $150000 per annum Job Title: Data EngineerCompany Description: My client are a boutique tech-focused consultancy renowned for their vibrant work culture and commitment to innovation. They are seeking a talented Data Engineer to join the team in Perth.Job Description: As a Data Engineer, you will play a crucial...

  • Data Engineer

    2 weeks ago


    Perth, Western Australia Opus Recruitment Solutions Ltd Full time

    Job Title: Data EngineerCompany Description: My client are a boutique tech-focused consultancy renowned for their vibrant work culture and commitment to innovation. They are seeking a talented Data Engineer to join the team in Perth.Job Description: As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining their clients...

  • Data Engineer

    2 weeks ago


    Perth, Western Australia Pyramid Global Technologies Full time

    About the job Data Engineer Role Data Engineer Required Technical Skill Set 1) Strong Data Engineering skills using Azure and Pyspark 2) Good Knowledge on SQL 3) Preferred experience in Big data/Hadoop technologies like Spark, Hive, Hbase and Kafka. 4) Preferred experience in ETL process. 5) Good Communication Skills Desired Experience Range 5 – 10 years...

  • Data Engineer

    2 weeks ago


    Perth, Western Australia Verse Group Full time

    Data Engineer – EducationAre you a Data Engineer who thrives in a collaborative environment? We are working with one of Perth's established educational institutions to find a Data Engineer to play a vital role in ensuring data reliability, quality, and integrity.Role Overview:In this role, you'll be responsible for designing, building, and maintaining data...

  • Data Engineer

    2 weeks ago


    Perth, Western Australia RGIT Australia Full time

    Summary:Reporting to the Head of Professional Services our Data Engineers are responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our customers data-driven initiatives. Our Data Engineers collaborate closely with OneStep team members, customer teams and stakeholders to understand data requirements,...

  • Data Engineer

    2 weeks ago


    Perth, Western Australia ROBERT WALTERS AUSTRALIA Full time

    Focus: Business intelligence / data analytics Contract type: FULL_TIME Specialism: Information Technology Focus: Business intelligence / data analytics Industry: IT Salary: + super Workplace Type: Hybrid Experience Level: Associate Location: Perth FULL_TIME Consultant: Milena Wawrzyniak-Kalyanpur Job reference: /001 Date posted: 5 June 2024 ...

  • Data Engineer

    2 weeks ago


    Perth, Western Australia Paxus - Technology + Digital Talent Full time

    Collaborate with the project team and a multidisciplinary engineering team on innovative technology for heavy mining and railway equipment.Oversee test data management and data offloading pipeline for Green Fleet projects.Establish standards for data signal naming to ensure uniformity and consistency across the entire data pipeline.Design efficient database...

  • Data Engineering

    2 weeks ago


    Perth, Western Australia Green Light Full time

    Perth based Health Initial 5months +extensionAbout the company: Green Light is one of Australia's most successful and fastest-growing IT services businesses. We offer a wide range of IT services in Security, infrastructure, and Systems Integration to a diverse customer base throughout Australia, New Zealand, SE Asia, and Europe.About the engagement:Green...

  • Data Engineer

    2 weeks ago


    Perth, Western Australia Curtin University Full time

    Job Reference: 1169040Digital & Technology Solutions (DTS)Embark on an Exciting Tech Journey with Curtin UniversityAre you passionate about technology, innovation, and driving change? Join us as we celebrate the successful completion of our digital transformation at Curtin University, a forward-thinking institution leveraging major platforms like Amazon Web...

  • Data Engineer

    2 weeks ago


    Perth, Western Australia Verse Group Full time

    Data Engineer – Initial 6 month contract + extensionAre you a Data Engineer interested in working on cutting-edge technology for a global business?Join our client working for mobile heavy mining equipment and railway systems on an initial 6 month contract with possible 6 month extension. You will have a crucial role in their upcoming strategic initiatives...

  • Data Engineering

    2 weeks ago


    Perth, Western Australia Green Light Full time

    Fulltime / Part time PerthAbout the company:Green Light is one of Australia's most successful and fastest-growing IT services businesses. We offer a wide range of IT services in Security, infrastructure, and Systems Integration to a diverse customer base throughout Australia, New Zealand, SE Asia, and Europe.About the engagement: Green Light has an...

  • Data Devops Engineer

    2 weeks ago


    Perth, Western Australia Digital Resources Full time

    Data Dev Ops Engineer About Us: Come join our client who is a global leader, where doors to advancement, growth, and learning opportunities swing wide open.Here's your chance to step into a realm where innovation meets ambition, and where your career trajectory is bound only by your imagination.What awaits you: Imagine being part of a trailblazing force,...


  • Perth, Western Australia Aviva Full time

    Data Engineering AssociateSalary: National: up to £35,000 / London: up to £45,000This is a great job for someone / Are you someone who / Do you love toDo you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity to join our highly skilled Data Engineer community.Within one of our Data...


  • Perth, Western Australia Aviva Full time

    Data Engineering Associate Salary: National: up to £35,000 / London: up to £45,000 This is a great job for someone / Are you someone who / Do you love to Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity to join our highly skilled Data Engineer community. Within...


  • Perth, Western Australia The Staffing Group Full time

    About the roleData Engineers in Water Corporation are part of DataOps team with the primary goal of helping business intelligence, data science, advanced analytics and data governance teams across the business be more effective and productive with their data and analytics initiatives. This is achieved through a high-quality ecosystem of data, systems, tools...


  • Perth, Western Australia Water Corporation Full time

    Primary Location WA-Perth - Inner-John Tonkin Water Centre - LeedervilleOrganization Data & Analytics- Help us build one of the most advanced enterprise data platforms in WA:Permanent full-time opportunity with flexible working conditions:- Salary level 5:$112,195+ Super + Benefits**About the roleData Engineers in Water Corporation are part of DataOps team...


  • Perth, Western Australia Efinancialcareers Ltd. Full time

    Principal Data Engineer - Transformation Lead Commonwealth Bank of Australia Perth, Australia Principal Data Engineer - Transformation Lead Commonwealth Bank of Australia Perth, Australia Posted 2 days ago Permanent Competitive You are collaborative and enjoy solving analytical problems to help our team to reach highest potential We are a team of big...

  • Data Engineer

    2 weeks ago


    Perth, Western Australia Verse Group Full time

    Engagement Type: 12 Month ContractLocation: PerthWe aim to support our client's strong commitment to green energyWe're in need of an experienced Data Engineer to be part of the team on a 12-month contract in Perth. You'll have a significant role in their new Heavy Industry strategic projects to transform the way their fleets are powered.The right fit for...