Data Engineer

3 weeks ago

Council of the City of Sydney, Australia Imaginedata Full time

This role is responsible for the design and implementation of AUSTRAC Application Programming Interface (APIs) or key internal and external interfaces, primarily for the Reporting Entity System Transformation (REST) program. The design and implementation of these APIs are vital to the provision of high throughput as well as be intuitive for internal and external clients to use (e.g. follow best practice for documentation).

This role is also responsible for the co-ordination of the weekly release process, which delivers changes into the production environments. The Data Engineer will work collaboratively with management and across development teams to assist with the delivery and enhancement of new and existing projects.

Responsibilities and Requirements

The successful candidate will have the following skills:

- Degree in Computer Science or equivalent.
- Excellent development skills in Java and Scala.
- Extensive experience in building and documenting client facing interfaces (i.e. APIs) using the springboot framework.
- Hands on experience using parallel processing technologies including Apache Spark, Kafka and the Elastic stack (Kibana, Logstash, Elasticsearch).
- Experience in choosing & writing efficient processing algorithms.
- Ability to co-ordinate a release across a medium sized team, including release documentation for sign off.
- Ability to write complex and optimized queries against both SQL and NoSQL data stores.
- Previous experience with containerisation tools and processes.
- An understanding of Continuous Delivery techniques and tools (including Jenkins).
- Knowledge of the methodology used by the DTA.

#J-18808-Ljbffr

  • Data Engineer

    7 days ago

    Council of the City of Sydney, Australia FinXL Full time

    Data Engineer Leading Government client (consulting through FinXL) FinXL Professional Services is a leading IT consultancy that partners with clients to bridge the gap between business needs and technology capabilities. Since 2003, we've been delivering high-value ICT services across government, finance, telecommunications, and enterprise sectors. FinXL is...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Data Engineer

    3 weeks ago

    Council of the City of Sydney, Australia GrainCorp Full time

    Overview GrainCorp is currently seeking a Data Engineer to join a motivated and collaborative team delivering data, infrastructure, and system activities to support advanced analytic use cases. You’ll have the opportunity to work from multiple exciting AI and IoT projects and be trained by experts who’ve been in this space for...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Data Engineer

    3 weeks ago

    Council of the City of Sydney, Australia UTS College Limited Full time

    Overview UTS College is the premium pathway for students into the University of Technology Sydney (UTS), Australia's number one young university. Our vision is to actualise potential and enhance lives through the power of learning, our actions, and our people. Our purpose is to provide the best available opportunity for students to develop the knowledge,...

  • Data Analytics Engineer

    3 weeks ago

    Council of the City of Sydney, Australia ASX Full time

    Data Analytics Engineer page is loaded## Data Analytics Engineerremote type: Hybridlocations: Sydneytime type: Full timeposted on: Posted Todayjob requisition id: JR100650# **ASX: Powering Australia's financial markets**# When you join ASX, you’re joining a company with a strong purpose – to power a stronger economic future by enabling a fair...

  • Senior Data Engineer

    2 weeks ago

    Council of the City of Sydney, Australia Michael Page Australia Full time

    Respected firm driving innovation & teamwork in digital transformation. A clear runway to build, create, and move with velocity. About Our Client This organisation operates within the business services industry and boasts a robust presence as a mid-sized player. They are known for their focus on digital innovation and delivering data-driven solutions to...

  • Principal Data Engineer

    5 days ago

    Council of the City of Sydney, Australia Deputy Full time

    Deputy is a global SaaS remote‑first workforce management company with hubs in Sydney, Melbourne, San Francisco and London, plus team members working remotely across the United States. Our platform serves over 1.5 million workers and 375,000 workplaces across 100+ countries. We are backed by top global investors and recently achieved Unicorn status. At...

  • Analyst, Data Engineer

    7 days ago

    Council of the City of Sydney, Australia ASX Full time

    Analyst, Data Engineer page is loaded## Analyst, Data Engineerremote type: Hybridlocations: Sydneytime type: Full timeposted on: Posted 10 Days Agojob requisition id: JR100657# **ASX: Powering Australia's financial markets**# When you join ASX, you’re joining a company with a strong purpose – to power a stronger economic future by enabling a...

  • Principal Data Architecture and Engineering

    2 weeks ago

    Council of the City of Sydney, Australia CoStar Group, Inc. Full time

    Overview Principal Data Architecture and Engineering role at Domain + CoStar Group. This role sits at the heart of delivering trusted, AI-driven insights to millions of property seekers and professionals. What success looks like - Faster deployment of new data products and pipelines - Enterprise-wide adoption of the canonical data model - Measurable...