Data Engineers

Found in: Talent AU C2 - 3 weeks ago


Canberra, Australia Softtest pays pty ltd Full time

Australian Citizens residing in Australia with ability to obtain Baseline Clearance only respond.

  • Contract start 18 December 2023 to 30 June 2024, 2 x 12 months.
  • Australian Citizen, Ability to obtain Baseline Clearance, Canberra, Offsite role.

Send your responses to jobs@softtestpays.com

Overview

The Department of Agriculture, Fisheries and Forestry (DAFF) is looking for Data Engineers with strong experience developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes across several data and analytics platforms to join its Enterprise Analytics section.

The role will be responsible for design, development and unit testing activities across several data movement and transformation processes within DAFF. These data movement processes are being developed to focus on the preparation of data for use in decision making processes across the department, utilising modern cloud technology (Azure) to enable operational analytics use cases.

The successful candidate will require experience with the following techniques and technologies:

  • MS Azure Stack
    • Data Integration
      • Data Factory
      • SQL Server Integration Services
      • Databricks
    • Data Store
      • SQL Server
      • Data Lake Storage
    • Analytics
      • Azure Databricks
      • Azure Machine Learning
      • ArcGIS Enterprise
  • Development Tools DevOps, Visual Studio, VS Code
  • Data technology solutions sourcing (Oracle, Ingres, Azure, SQL Server), collecting, ingesting and storing
  • Data Preparation
    • Transformation of data into formats tailored to analytics use cases
      • Parquet
      • Delta

Every application requires to address selection criteria as part of application submission.

Essential Criteria Weighting

1. Experience developing ETL/ELT processes for data movement and transformation. 25%

2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL 25%

3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. 25%

4. Working with multi-disciplinary teams using an Agile methodology 25%

Desirable Criteria Weighting

1. Experience working with Azure Data Factory and Databricks

2. Experience/Knowledge of working with Data Lake and Lakehouses



  • Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia only respond.Data Analyst ManagerData Engineering ExpertSenior Data Analyst ManagerSenior Data Engineering Expert CitizenACT, QLD, SA, VICServices Australia is seeking to identify suitable Candidates to perform the roles of Data Analyst and Data Engineers from manager and expert to senior manager and senior expert...

  • Data Engineer

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens With ability to obtain NV1 Clearance residing in Australia only respond Contract start 01 January 2024 to 30 June 2024, 12 months extensions.Australian Citizen, Ability to obtain NV1 Clearance, Canberra role.Send your responses to jobs@softtestpays.comThe role will be responsible for, but not limited to:Collaborate with team members and...

  • Data Engineer with Python

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Unison Consulting Pte Ltd Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. Optimize and troubleshoot AWS Glue jobs for performance and reliability. Utilize Python and PySpark to efficiently handle large volumes of...

  • Data Operations Engineer

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Please respond to the job if you are an Australian Citizen and residing in Australia.Contract start 06 March 2023 To 24 months, 12 months extensions.Australian Citizen, Ability to obtain Baseline Clearance, Canberra role.Send your responses to jobs@softtestpays.comOverviewThe Data & Innovation section within the Clean Energy Regulator requires a temporary...

  • ETL Developer

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Please respond to the job if you are an Australian Citizen and residing in Australia.Contract start 01 July 2023 To 12 months, 2 x 12 months extensions.Australian Citizen, ability to obtain Baseline Clearance, Canberra, Offsite role.Send your responses to jobs@softtestpays.comOverviewData Engineering, in the Centre of Data Excellence (CODE) is seeking an ETL...

  • Oracle Developer data engineer

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia with Baseline Clearance only respond.Essential criteria1. Background as an Oracle Developer / Oracle Data Engineer Strong proficiency in Oracle database technologies, SQL, PL/SQL, and experience with Oracle Data Integrator (ODI) and Oracle Business Intelligence Enterprise Edition (OBIEE). Applicants must possess a...

  • Enterprise Data Warehouse Engineer

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Contract start 06 March 2023 To 12 months, 12 months extensions.Australian Citizen, Canberra, Sydney, Brisbane, Adelaide, Melbourne, Hobart, Hybrid(3 days in office 2 days at home) role.Send your responses to jobs@softtestpays.comOverviewPosition PurposeThe Senior EDW engineer will advise, design, model and deliver strategic data assets to the data users and...

  • Data Engineer

    Found in: Talent AU C2 - 2 weeks ago


    Canberra, Australia Allura Partners Full time

    Data EngineeringNeo4jNV2 Government clearance Cloud Engineer / Platform Engineer / 6 Months Contract / Neo4j / NV1 security clearance / $1,100 to $1,200 a dayI am working with a Government department who are looking for a Platform engineer with skills in Neo4j, who can do integration deployment. - Neo4j application installation - Configuration - Integration...

  • Data Enginner

    3 days ago


    Canberra, Australia Minutes To Seconds Full time

    About the job We would love the opportunity to work with YOU!! Minutes to Seconds is looking for a Data Engineer in a Hybrid role at ACT. Clearance: Baseline Key responsibilities: - Building data sets, data products, data pipelines and software solutions must be created, maintained and optimised as workloads move from development to production for...

  • Configuration and Data officer

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens With NV1 Clearance residing in Australia only respondMaintain the Technical Data Management Plan (TDMP) within the Engineering Management System (EMS) in support of the CMGR and DAARCollection and curation of technical data within technical data packsEnsuring the correct storage of data for its security classificationCreate and...

  • Data Manager

    3 days ago


    Canberra, Australia KBR Full time

    **Title**: Data Manager The Company Kellogg Brown and Root (KBR) is a leading Defence and Government professional services provider. KBR Australia has been engaged in working with Defence and Defence Industry for over 20 years and has core competencies in program and project management, engineering, asset management, integrated logistics support,...


  • Canberra, Australia ACT Government Full time

    Details : Digital, Data and Technology Solutions is looking for an energetic person to join the Corporate Applications Section as Data and Analytics Engineer. The successful candidate will work within a small Power BI team, whilst also working in cooperation with other technical specialists, vendors, and ACT Government directorates. A key element of the...

  • Python API Develper and/or Data Engineer

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens With ability to obtain NV1 Clearance residing in Australia only respond The AFP has a requirement for an experienced Python API Developer and/or Data Engineer to work together with Covert & Technical Operations technical staff in furthering the integration of its covert collection, analysis and compliance systems for the Data Management...

  • Data Analyst

    3 days ago


    Canberra, Australia HorizonOne Recruitment Full time

    **The Opportunity**: Broaden & develop your skillset across whole data lifecycle from design to data management, data engineering, data analysis and data visualisation (Power BI). Be involved in the design of models to support a new system in this recently established MoG’d department. In addition, you will work alongside advanced data professionals (6x...

  • Engineering Manager

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens With NV1 Clearance residing in Australia only respond Contract start 1/05/2023 to 30/06/2025.Australian Citizen, NV1 Clearance, Canberra, Offsite role.Send your responses to jobs@softtestpays.comRequirements of the Role:Tasks include, but may not be limited to;Leading and Managing a small team of competent Engineering...

  • Data Analyst

    4 days ago


    Canberra, Australia Modis Full time

    **June 2023 contract + extensions**: - **Baseline clearance required**: Have you been considering transitioning into a new position in 2023! Are you a skilled Data Analyst with a current Baseline Clearance? This might be the perfect role for you! **Our client**: Lifelong learning is essential for us to grow continuously and live a fulfilling life. Be a...

  • Configuration and Technical data officer NV1

    Found in: Talent AU C2 - 2 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens With NV1 Clearance residing in Australia only respond Maintain the Technical Data Management Plan (TDMP) within the Engineering Management System (EMS) in support of the CMGR and DAARCollection and curation of technical data within technical data packsEnsuring the correct storage of data for its security classificationCreate ...

  • Data Analyst

    5 days ago


    Canberra, Australia Modis Full time

    **12 month + 2 x 12 month contract**: - **Must have Negative Vetting Level 1**: - **Salesforce Service Cloud or Public Sector Cloud knowledge and experience are highly desirable** Are you a talented **Data Analyst** looking for your next amazing project? Look no further, Akkodis has received a **long term position** within a large federal government...

  • Project Engineer

    Found in: Talent AU C2 - 5 days ago


    Canberra, Australia Australian Government Department of Defence Full time

    The Role The Land Intelligence Surveillance and Reconnaissance and Electronic Warfare (LISREW) Program is seeking an engineer to support the capability management of the Intelligence and Information Warfare (I&IW) capability. In this role, the engineer will work closely with the program systems engineer and AHQ stakeholders to develop and propose...

  • Engineering support Officer

    Found in: Talent AU C2 - 3 weeks ago


    Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens With NV1 Clearance residing in Australia only respond This role is within CASG, working in CJC03 as a part of the Joint Data NetworksSub-Program. The successful candidate will, on behalf of the Product andOperations Manager, manage the CJC03 Engineering day to day activities. Thesuccessful applicant will interact with a broad variety of...