ETL Developer

1 month ago

Canberra, Australia Softtest pays pty ltd Full time

Please respond to the job if you are an Australian Citizen and residing in Australia.

  • Contract start 01 July 2023 To 12 months, 2 x 12 months extensions.
  • Australian Citizen, ability to obtain Baseline Clearance, Canberra, Offsite role.

Send your responses to jobs@softtestpays.com

Overview

Data Engineering, in the Centre of Data Excellence (CODE) is seeking an ETL Developer / Data Engineer to provide technical leadership to carry out development of and provide production support for a series of data load or data replication workflows on our AWS-based Data Lake platform.

The responsibilities of the ETL Developer / Data Engineer will include, but are not limited to:
Liaise with internal and external clients to determine requirements and design solutions.
Design ETL routines for ingestion of data from existing source systems including but not limited to: Oracle databases, Postgres databases and data delivered as CSV, JSON or XML via API or file transfer protocols such as SFTP.
Build and maintain data ingestion pipelines using technologies such as AWS DMS and AWS Glue, Pyspark and Iceberg.
Define the database schema for intermediate data transformations.
Contribute to the development of data load/migration plans, including effort estimates.
Contribute to the specification of data transformation, both content and structure, for end-to-end load/migration from source to target systems.
Define and construct cleansing rules to be implemented as part of the data load/migration routines.
Implement (including design, build and test) the data extract, transform, load (ETL) routines to load data from one system to another and/or migrate data from current to future data stores.
Participate in discussions on data transformations with business and technical areas.
Provide technical leadership and mentoring to a small team, including active knowledge transfer.

Every application requires to address selection criteria as part of application submission

Essential Criteria

1. The successful candidate enjoys working in a tight-knit agile team providing data capabilities and services to technical and business stakeholders. You communicate well (verbally and in writing), share knowledge and experiences, have a can-do and flexible approach, and follow processes and documentation requirements. 30 %

2. You must have a strong knowledge of and demonstrated high-level experience in data analysis, problem-solving and ETL development, including design, build, test and deployment. 30 %

3. The successful candidate will be required to demonstrate experience with the following technologies:

- AWS Glue - AWS DMS - Apache Parquet - PySpark - Logstash - ElasticSearch - Iceberg

40 %

Desirable Criteria

1. Experience in the following areas: - Database design - Oracle DBMSs, Elasticsearch DBMSs and Azure services - Data load/migration projects including data profiling and data quality analysis.

2. Use of Informatica IICS, PowerCenter, Developer, Analyst or MDM tools

  • Oracle Developer

    4 weeks ago

    Canberra, ACT, Australia Randstad Australia Full time

    Our federal government client is seeking experienced Oracle Developers to join their ICT division. As a Oracle Developer professional, you will bring a deep understanding of Oracle database technologies, combined with a proven track record of leveraging Oracle Data Integrator (ODI) and Oracle Business Intelligence Enterprise Edition (OBIEE) to deliver...

  • Oracle Developer

    1 month ago

    Canberra, Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia only respond. Must have baseline clearance.Essential criteria1. Database Development and Maintenance: Develop and maintain robust database systems, including schema design, stored procedures, queries, and scripts for data manipulation and retrieval. Ensure high performance, security, and scalability of database...

  • Oracle Developer

    4 weeks ago

    Canberra, Australia Emanate Technology Full time

    Overview:Emanate Technology is proud to partner with a mid-sized Federal Government Department, seeking an experienced Oracle Developer to assist across a large ICT modernisation program looking to upgrade and improbe their entire Oracle and cloud landscape. The division is responsible for bridging technical and business domains to deliver data-driven...

  • Data Engineer with Python

    1 month ago

    Canberra, Australia Unison Consulting Pte Ltd Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. Optimize and troubleshoot AWS Glue jobs for performance and reliability. Utilize Python and PySpark to efficiently handle large volumes of...

  • Technical Delivery Team

    4 weeks ago

    Canberra, Australia Indigitise Full time

    MUST Hold NV1/NV2 - Exciting Career Opportunities with the **Australian Signals Directorate** **Technical Delivery Team** based in **Canberra. **Indigitise is proud to assist the recruitment process for these critical positions. **MUST Hold NV1/NV2** Applications close on Tuesday 17th of August!! **Data Engineering Positions** Data Architect Data...

  • Account Executive

    4 weeks ago

    Canberra, Australia Snowflake Full time

    Due to growth plans across the entire APJ region and investment in the Federal Government market, we are looking for an Enterprise Account Executive to join our Federal Government team. **WE ARE LOOKING FOR SOMEONE WITH**: - Customer obsession and a passion for building new business in a fast paced environment. - 10+ years of field sales experience...

  • Data Migration Lead

    1 month ago

    Canberra, Australia Publicis Sapient Full time

    Job Description As a Data Migration Lead, you'll lead the data migration and analysis work for our clients, partnering closely with our teams and clients to shape and identify requirements and develop new data models in line with the client’s data migration strategy. This role is at the heart of our digital transformation projects, where you will...

  • Data Analyst

    5 days ago

    Canberra, Australia Agylex-Sprinx Global Full time

    One of the **Esteemed Federal Clients **in **Canberra, ACT **is hiring a **"Data Analyst - Visual Analytics" **for a duration contract. **Title - **Data Analyst - Visual Analytics **Location-** ACT **Working Arrangement - **Onsite **Opportunity type - **Contract **Australian Citizens with Baseline are applicable for this role.** **Requirements**: The...

  • EL 1 - DBA/Datawarehouse Systems Engineer

    3 days ago

    Canberra, Australia National Library of Australia Full time

    New role designed to advance and maintain the National Library’s Analytics Platform (LAP) project while also managing traditional DBA functions in this dynamic position. Utilise your expertise in database management systems and cloud technologies to support business needs and enhance data analytics capabilities. Opportunity to use your strong...

  • Technical Lead Data

    1 month ago

    Canberra, Australia Leidos Full time

    Company Description Every person at Leidos plays an important and valued role bringing science, engineering and technology together to produce practical solutions for our customers’ most complex problems. It’s how we help to make the world safer, healthier and more efficient - work that matters and a mission, like those of our customers, we are...