Data Engineer

1 month ago


Canberra, Australia Softtest pays pty ltd Full time

Australian Citizens With ability to obtain NV1 Clearance residing in Australia only respond 

  • Contract start 01 January 2024 to 30 June 2024, 12 months extensions.
  • Australian Citizen, Ability to obtain NV1 Clearance, Canberra role.

Send your responses to jobs@softtestpays.com

The role will be responsible for, but not limited to:

Collaborate with team members and stakeholders to design data integration solutions that meet business requirements, utilising Microsoft Azure tools such as Azure Data Factory and SQL.

Develop, implement, and maintain ETL pipelines to ensure efficient and secure data transfer between various systems, adhering to best practices for data processing and transformation.

Design and maintain data models, ensuring data accuracy, consistency, and availability while considering scalability and performance optimisations.

Implement data validation and quality checks to identify and rectify data anomalies, errors, and inconsistencies within integrated systems.

Continuously monitor and optimise data integration processes to enhance performance, reduce latency, and minimise resource consumption.

Create and maintain comprehensive documentation for data integration solutions, including technical specifications, data flow diagrams, and operational procedures.

Work closely with cross-functional teams, including developers, and system analysts, to understand data requirements and ensure integrations align with business objectives.

Troubleshoot and resolve data integration issues, working collaboratively with the team to implement effective solutions and prevent recurrence.

Stay updated on emerging technologies and industry trends related to data engineering and integration, applying this knowledge to improve integration processes and tools.

Every application requires to address selection criteria as part of application submission.

Mandatory:

Proven experience in data engineering, including data integration, ETL processes, and data modelling.

Strong SQL skills and experience with data warehousing concepts.

Knowledge of data governance, security, and compliance best practices.

Excellent problem-solving skills and the ability to work effectively in a collaborative team environment.

Effective communication skills for collaborating with technical and non-technical stakeholders.

Demonstrated ability to build and maintain effective working relationships.

Ability to work independently and be a self-motivated individual.

Desirable:

Proficiency in Microsoft Azure tools and services, such as Azure Data Factory, and Azure SQL Database.

Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).

Relevant certifications (e.g., Microsoft Azure Data Engineer, AWS Certified Data Analytics) are advantageous.



  • Canberra, Australia Unison Consulting Pte Ltd Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. Optimize and troubleshoot AWS Glue jobs for performance and reliability. Utilize Python and PySpark to efficiently handle large volumes of...


  • Canberra, Australia SOS Recruitment Full time

    Job Description 12-month contract  | Canberra Location | $52.14 - $64.76 per hour plus 11% Superannuation  OVERVIEW Our Federal Government client is currently seeking an experienced Data Analyst and a Data Engineer to join their team at the APS5/6 level. The level will be determined based on skills and experience. Within the Data Analyst role you will...


  • Canberra, Australia Allura Partners Full time

    ClouderaDataAzure Cloudera Data Platform Engineer - Contract, $1,200 to $1,300 a day / NV1 - NV2I am working with a Government department who are looking for an engineer with Cloudera experience for a new projectIn the role you will be responsible for the Cloudera Data platform and have experience in the following:- Experience in deployment of Cloudera Data...

  • Data Analyst

    1 month ago


    Canberra, Australia HiTech Personnel Full time

    **Reference #**: - JF/JJ2302**Title**: - Data Analyst - SQL, Power BI, Python**Category**: - ICT**Location**: - ACT**Work Type**: - Contract**Remuneration**: - $Neg**Term**: - 12 months + 24 month**Description**: - **High Profile Federal Government Department!**: - **Initial contract 12 month with 2 x 12 month extension options!**: - **Rewarding...


  • Canberra, Australia Australian Government Department of Defence Full time

    $108,195 - $122,044 (plus Super) - Brindabella Park - ACT, Sydney CBD - NSW **The Role** The Directorate of Maritime Engineering & Logistics (DMEL) is seeking a highly skilled and motivated EL 1 Business Intelligence Manager to join our dynamic data team. You will be responsible for overseeing the development and implementation of data driven strategies to...

  • Technical Lead Data

    1 month ago


    Canberra, Australia Leidos Full time

    Company Description Every person at Leidos plays an important and valued role bringing science, engineering and technology together to produce practical solutions for our customers’ most complex problems. It’s how we help to make the world safer, healthier and more efficient - work that matters and a mission, like those of our customers, we are...


  • Canberra, Australia Kinexus Australia Full time

    **ABOUT THIS ROLE** Data Centre Technician (Multiple) - RFQ-ASD-42-2023 - SOW 1 - Original Technology Foundation - High Side Infrastructure Group (TF-HSI) within the Australian Signals Directorate (ASD), will deliver cutting edge capabilities to support ASD's Signals Intelligence and Offensive Cyber Capabilities. These capabilities consists of a combination...

  • Project Engineer

    3 weeks ago


    Canberra, Australia Australian Government Department of Defence Full time

    The Role The Land Intelligence Surveillance and Reconnaissance and Electronic Warfare (LISREW) Program is seeking an engineer to support the capability management of the Intelligence and Information Warfare (I&IW) capability. In this role, the engineer will work closely with the program systems engineer and AHQ stakeholders to develop and propose...

  • Data Analyst

    1 month ago


    Canberra, Australia Leidos Full time

    Company Description The first thing you learn at Leidos Australia is to leave current thinking at the door. Our aim is to make the world a safer, healthier and more efficient place, but we won’t get far using existing ideas. Due to our ongoing success, the Leidos family is growing rapidly across Melbourne and Canberra. This year is set to be an amazing...


  • Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens With NV1 Clearance residing in Australia only respond This role is within CASG, working in CJC03 as a part of the Joint Data NetworksSub-Program. The successful candidate will, on behalf of the Product andOperations Manager, manage the CJC03 Engineering day to day activities. Thesuccessful applicant will interact with a broad variety of...


  • Canberra, Australia KBR Full time

    **Title**: Data Assurance Manager **The Company**: Kellogg Brown and Root (KBR) is a leading Defence and Government professional services provider. KBR Australia has been engaged in working with Defence and Defence Industry for over 20 years and has core competencies in program and project management, engineering, asset management, integrated logistics...


  • Canberra, Australia Hughes and Jones Consulting Full time

    Australia's leading cyber security intelligence consultancy continuing to expand cyber security operations, threat analytics, security integration and engineering capability for large enterprise projects. Fast-paced dynamic environment offering excellent career advancement opportunities and training structure to support ongoing certification and further...


  • Canberra, Australia Hughes and Jones Consulting Full time

    Australia's leading cyber security intelligence consultancy continuing to expand cyber security operations, threat analytics, security integration and engineering capability for Government and Defence projects. Fast-paced dynamic environment offering excellent career advancement opportunities and training structure to support ongoing certification and...

  • Data Migration Lead

    1 month ago


    Canberra, Australia Publicis Sapient Full time

    Job Description As a Data Migration Lead, you'll lead the data migration and analysis work for our clients, partnering closely with our teams and clients to shape and identify requirements and develop new data models in line with the client’s data migration strategy. This role is at the heart of our digital transformation projects, where you will...

  • Network Engineer

    3 days ago


    Canberra, Australia Fujitsu Full time

    About the role 12 Months Contract AGSVA Security Clearance Required Defence Opportunity We are seeking an experienced Network Engineer with an AGSVA Security Clearance to work with the Project Manager and Solutions Architect in developing, configuring, maintaining and documenting key components of a Defence stand-alone network for implementation...

  • ILS Engineer

    19 hours ago


    Canberra, Australia CEA Technologies Full time

    Join an internationally recognised world-leading radar and communication systems supplier Work with high performing Subject Matter Experts who creatively solve problems together. Deliver logistic-engineering services to the Commonwealth and CEA's internal stakeholders. Providing innovative technology solutions with commitment to strengthen Australia's...

  • DevOps Engineer

    2 weeks ago


    Canberra, Australia Allura Partners Full time

    AzureDevOpsTerraform DevOps Engineer / Platform Engineer / 6 months Contract / $1,100 to $1,300 a day / AzureI am working with a Government department who are looking for an engineer with DevOps/ cloud skills in Azure, for a new project.- Azure Cloud- Infrastructure- Ansible or similar- Terraform or similarThis is a long term role which will start with 6...


  • Canberra, Australia Australian Government Department of Defence Full time

    Non-Ongoing & Ongoing - $85,607 - $97,790 (plus Super) - Various - ACT, Various - NSW, Various - NT, Various - QLD, Various - SA, Various - TAS, Various - VIC, Various - WA **The Role** Exciting opportunities exist for Data Officers to join Data Division at the APS 6 level Data Scientist: - Undertake research and analysis, conduct investigations and...


  • Canberra, ACT, Australia Randstad Australia Full time

    Canberra based role12 month contractNV1 clearance essentialOur federal government client is seeking an experienced M365 Engineer Specialising in Power Platform to create written designs, implement, and assist in the technical operational and governance functions of some of the following services within an existing Microsoft 365 ecosystem:Microsoft Dynamics...


  • Canberra, Australia KBR Full time

    Title: Engineering Manager – Engineering, Analysis and Innovation Your KBR future – delivering solutions and changing the world About KBR: We are a company of innovators, thinkers, creators, explorers, volunteers and dreamers who all share one goal — to improve the world. KBR delivers science, technology and engineering solutions to...