Data Engineers

3 weeks ago

Sydney, New South Wales, Australia CYOS Solutions Full time

Application closing date: Friday, 14 June 2024
• 11:59pm, Canberra time

Estimated start date: Monday, 01 July 2024

Location of work: NSW

Working arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability. Interstate candidates will also be considered. However, there will be a requirement to attend workshops, meetings and other on-site duties as directed from time to time.

Length of contract: 12 months

Contract extensions: 1 x 12 months

Security clearance: Must be able to obtain Baseline clearance

Rates: $110 - $140 per hour (inc. super)

The Clean Energy Regulator is inclusive and agile, with staff at all levels being part of conversations with the senior executive and being offered the opportunity to experience different types of work. We pride ourselves on our diverse and inclusive workplace. If you're Aboriginal or Torres Strait Islander peoples, living with disability or a mature age worker, we encourage you to apply.

The role of the Transformation Office is to provide insights, solutions and advice to decision makers, policy makers and the market to improve scheme operations and position the agency as a modern, efficient and effective regulator.

Branch objectives:

  • Provide advice, capability uplift and support to the agency's transformation Program design and implementation that is viable, desirable and sustainable.
  • Create a renewed focus on synergising interdependencies, maturing governance, driving business transition and benefits realisation through the CER Change Program.
  • Support the Chief Data Officer and the agency to create a data-driven culture that identifies external trends to inform strategic decisions and support business transformation.
  • Model and embed best practice across portfolio, program and project management in delivering our strategic objectives and outcomes for the agency.

The Data Innovation and Tools section supports the agency to unlock the potential of our data to drive innovation and compliance for the agency.

Specific responsibilities include:

  • Support the Chief Data Officer and the agency in delivering the Data and Reporting Strategy to improve data governance.
  • Support business areas to improve data transparency under the agency's open data policy.
  • Promote and facilitate sharing of scheme data across Commonwealth agencies.
  • Provide a point of liaison between the Digital Services branch and business areas on the delivery of data services infrastructure under the Data Services Roadmap.
  • Build agency analytics capability, and utilise data analytics and geospatial analytics to:

» Support the integrity of agency schemes by detecting, predicting and preventing non-compliance.

» Provide insights and evidence to decision-makers and other stakeholders on the behaviour of our clients and the trends and outcomes in our schemes.

» Identify and deliver business improvements and efficiencies.

» Support innovative approaches to reduce regulatory burden, support self-service approaches, improve efficiency and encourage compliance with our schemes – by:

› Working with business areas to identify, prioritise and implement innovative approaches to scheme and participant needs or problems.

› Provide targeted skills and resources to consult on, design, build and/or roll out strategic initiatives that result in improvements to internal processes, data collection, client compliance, and communication related to scheme operations.

Role Responsibilities and Duties

  • Design, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack.
  • Develop scalable architecture practices for pipeline designs.
  • Lead data migration and integration for critical change programs.
  • Ensure data integrity and align engineering tasks with program objectives.
  • Mentor team members and drive new data engineering practices adoption.
  • Monitor and improve data service performance and costs.
  • Maintain documentation and adhere to data governance policies.
  • Research and innovate within the Azure data engineering field.

Qualifications/Experience

  • Bachelor's degree in computer science, Engineering, or a related field.
  • Certifications in Azure Data Services, such as the Microsoft Certified: Azure Data Engineer Associate.
  • 3+ years of experience in data engineering with a focus on Azure services.
  • Proven experience with Azure Data Lake, Azure Synapse Analytics, and CI/CD pipelines.
  • Demonstrated ability to design and implement scalable data architectures.
  • Experience in data migration and managing large-scale data pipelines.
  • Familiarity with DevOps practices and tools within the Azure ecosystem.
  • Strong technical skills in SQL, Python, and R
  • Proficiency in data modelling including reuse and scalability patterns
  • Knowledge of Azure Monitor, Azure Security, and compliance frameworks.
  • Ability to work with cross-functional teams and lead technical projects.
  • Experience building data profiling, data cleansing and data engineering frameworks.
  • Will require Australian Citizenship with a Baseline Security clearance as a minimum.

HOW TO APPLY

Please provide an updated CV and provide a 500 word response to your ability to meet the skills, competencies and characteristics that reflects your suitability to the role based on the job description above.


  • Senior Azure Data Engineer

    4 days ago

    Sydney, New South Wales, Australia NTT DATA Full time

    Job Description NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network...

  • AWS Data Analyst

    4 days ago

    Sydney, New South Wales, Australia The Data Foundry Full time

    Job DescriptionYour impact As an AWS Data Analyst, you will play a key role in working with customers to understand their business requirements, map these to their data capabilities, liaise with our internal Data Engineers to design and build elegant solutions, then partner with our customers to deploy those solutions in a way that allows them to turn data...

  • Azure Devops Engineer

    4 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    Engineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights Join Microsoft's largest Australian Partner HRD Employer of Choice and Great Place to Work Brisbane, Sydney or Melbourne Based - Hybrid Working As an Azure Dev Ops Engineer you will work across multiple organisations, managing the latest...

  • Ms Engineer

    4 days ago

    Sydney, New South Wales, Australia Ntt Data Full time

    NTT DATA NTT DATA helps clients transform through consulting, industry solutions, business process services, IT modernization and managed services. View company page Want to be a part of our team?The Security Managed Services Engineer (L4) is responsible for ensuring a managed service is provided to all clients, to ensure that their Security infrastructure...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia HiTech Group Full time

    Leading Federal Government Department Initial 12 month contract + 12 month extension Rewarding daily rates $$$ A dynamic Federal Government Department is looking to engage an experienced Data Engineer to be apart of the department's internal key data centric projects. You will be responsible demonstrating strong data engineering and analytics skills with...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia HiTech Group Full time

    Exciting opportunity within a Federal Government Department Initial 12 month contract with EXTENSION options Rewarding hourly rates $$$ One of Australia's principal Federal Government departments is looking to engage a skilled Data Engineer & Data Modeller to assist in collaborating with key business areas in the development and implementation of consumable...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Experis ManpowerGroup Sp. z o.o. Full time

    Our government client are looking for several data engineers to join their team on a contract basis.Please note only Australian Citizens will be considered as security clearance is required.Role Responsibilities and DutiesDesign, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack.Develop scalable architecture practices...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Atlassian Full time

    We are looking for a Data Engineer to join our UIP - Frontend Observability team.The Frontend Observability team is part of the UI Platform organisation.Our team's mission is to help teams build fast experiences and make sure they stay fast. We build tools for measuring, monitoring and catching regressions in frontend performance.UI Platform delivers...

  • Data Engineering

    4 days ago

    Sydney, New South Wales, Australia Randstad Full time

    About the company: My client is a leading global multinational investment banking and financial services company. You will be joining the data engineering team to help build the best technology company in the financial services industry. You will play a leading role in shaping and driving the next evolution of their data and analytics platform, providing...

  • data engineer

    4 days ago

    Sydney, New South Wales, Australia Opus Recruitment Solutions Full time

    ApplyData Engineer Sydney, Australia Permanent$ $130000 per annum Are you a skilled Data Engineer looking for your next challenge? I am currently seeking a Senior Data Engineer with expertise in Azure, Azure Data Factory, Databricks, Synapse, Power BI, and strong experience in SQL to join my clients dynamic team.Responsibilities:Designing, building, and...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Practiv Limited Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Practiv Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Opus Recruitment Solutions Ltd Full time

    Apply Data EngineerSydney, AustraliaPermanent$ $130000 per annumAre you a skilled Data Engineer looking for your next challenge? I am currently seeking a Senior Data Engineer with expertise in Azure, Azure Data Factory, Databricks, Synapse, Power BI, and strong experience in SQL to join my clients dynamic team.Responsibilities:Designing, building, and...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia ClearCompany Full time

    Data Engineer Sydney $175,000 Inc Super + BonusAs a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment.Key...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Talenza Full time

    Data Engineer Sydney $170,000 Inc Super + Bonus As a Data Engineer within our dynamic Engineering team, you will play a crucial role in developing cutting-edge applications to support our Data Transformation initiatives. This is a permanent position offering the opportunity to work on innovative projects within a supportive team environment. Key...

  • Data Engineers

    4 days ago

    Sydney, New South Wales, Australia CYOS Solutions Full time

    Application closing date: Friday, 14 June 2024 11:59pm, Canberra timeEstimated start date: Monday, 01 July 2024Location of work:NSWWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability.Interstate candidates will also be considered.However, there will...

  • Data Engineers

    4 days ago

    Sydney, New South Wales, Australia CYOS Solutions Full time

    Application closing date: Friday, 14 June 2024 11:59pm, Canberra time Estimated start date: Monday, 01 July 2024 Location of work: NSWWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability.Interstate candidates will also be considered.However, there...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Kindred Group plc Full time

    The roleWe are looking for a motivated Data Engineer to join our team and support the Data Engineering pipeline design and implementation experience within a commercial environment.As a listed and regulated company, Kindred Group pays great attention to player safety and sustainability. Our purpose is to transform gambling by being a trusted source of...

  • Data engineer

    4 days ago

    Sydney, New South Wales, Australia CareCone Australia Full time

    Role: Data Engineer / Senior Data Engineer (Databricks) Location: Sydney Permanent (Full-time) Note:We are hiring for 3 Data Engineering role where Python, AWS/ Azure, Databricks & dbt is mandatory. Job DescriptionDemonstrated Experience (4 to 5yrs) in IT domain with experience in Python, AWS/ Azure, Databricks. Familiarity working with large systems...

  • Data Engineer

    4 days ago

    Sydney, New South Wales, Australia Tribus Technology Pty Full time

    Data Engineer Based in Sydney (1-2 days in the office)Join a dynamic engineering team undergoing a significant product transformation.In this role, you will ensure the quality of data from third-party feed providers and internal downstream processing.Collaborating with developers, business functions, and operations teams, you will uphold high standards for...