Data Engineer

7 days ago

Council of the City of Sydney, Australia Imaginedata Full time

This role is responsible for the design and implementation of AUSTRAC Application Programming Interface (APIs) or key internal and external interfaces, primarily for the Reporting Entity System Transformation (REST) program. The design and implementation of these APIs are vital to the provision of high throughput as well as be intuitive for internal and external clients to use (e.g. follow best practice for documentation).

This role is also responsible for the co-ordination of the weekly release process, which delivers changes into the production environments. The Data Engineer will work collaboratively with management and across development teams to assist with the delivery and enhancement of new and existing projects.

Responsibilities and Requirements

The successful candidate will have the following skills:

- Degree in Computer Science or equivalent.
- Excellent development skills in Java and Scala.
- Extensive experience in building and documenting client facing interfaces (i.e. APIs) using the springboot framework.
- Hands on experience using parallel processing technologies including Apache Spark, Kafka and the Elastic stack (Kibana, Logstash, Elasticsearch).
- Experience in choosing & writing efficient processing algorithms.
- Ability to co-ordinate a release across a medium sized team, including release documentation for sign off.
- Ability to write complex and optimized queries against both SQL and NoSQL data stores.
- Previous experience with containerisation tools and processes.
- An understanding of Continuous Delivery techniques and tools (including Jenkins).
- Knowledge of the methodology used by the DTA.

#J-18808-Ljbffr

  • Data Engineer

    4 weeks ago

    Council of the City of Sydney, Australia FinXL Full time

    Data Engineer Leading Government client (consulting through FinXL) FinXL Professional Services is a leading IT consultancy that partners with clients to bridge the gap between business needs and technology capabilities. Since 2003, we've been delivering high-value ICT services across government, finance, telecommunications, and enterprise sectors. FinXL is...

  • Data Engineer

    7 days ago

    Council of the City of Sydney, Australia TRAILD PTY LTD Full time

    About TRAILD TRAILD is a dynamic, fast-growing, remote-first SaaS company that streamlines, automates, and protects Accounts Payable (AP). Just as your bank provides always-on protection for your credit card, TRAILD delivers the same level of security to help businesses safeguard their B2B payments from fraud, errors, and mistakes. Our specialised...

  • Senior Data Engineer

    1 day ago

    Council of the City of Sydney, Australia Neara Group Full time

    Imagine preventing wildfires before they start, or ensuring power grids stay resilient during extreme weather. That’s the real-world impact we create every day at Neara. We build 3D physics-enabled digital twins of critical infrastructure networks that help utilities and infrastructure companies run scenarios, assess risks, and make smarter decisions that...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Senior Data Engineer

    3 weeks ago

    Council of the City of Sydney, Australia black.ai Full time

    Location Melbourne HQ or Sydney Employment Type Full time Department Engineering Who is Heidi? Heidi is building an AI Care Partner that supports clinicians every step of the way, from documentation to delivery of care. We exist to double healthcare’s capacity while keeping care deeply human. In 18 months, Heidi has returned more than 18 million...

  • Data Centre Design Manager — Lead Innovative Projects

    1 day ago

    Council of the City of Sydney, Australia CDC Data Centres Full time

    A leading data centre provider is seeking a Design Manager in Sydney. This role involves planning and managing the design process while collaborating with various teams to create innovative, high-quality designs. The ideal candidate will have strong design and engineering skills and be an effective team player. Essential qualifications include Australian...

  • Principal Data Engineer

    4 weeks ago

    Council of the City of Sydney, Australia Deputy Full time

    Deputy is a global SaaS remote‑first workforce management company with hubs in Sydney, Melbourne, San Francisco and London, plus team members working remotely across the United States. Our platform serves over 1.5 million workers and 375,000 workplaces across 100+ countries. We are backed by top global investors and recently achieved Unicorn status. At...

  • Platform Data Engineer

    1 week ago

    Council of the City of Sydney, Australia Macquarie Bank Limited Full time

    Overview Within Commodities and Global Markets, our Data Platform team is responsible for building and maintaining the data warehouse and re-usable ETL pipelines for engineering teams. You will work on building solutions for big data using the newest technologies available. At Macquarie, our advantage is bringing together diverse people and empowering them...

  • Analyst, Data Engineer

    4 weeks ago

    Council of the City of Sydney, Australia ASX Full time

    Analyst, Data Engineer page is loaded## Analyst, Data Engineerremote type: Hybridlocations: Sydneytime type: Full timeposted on: Posted 10 Days Agojob requisition id: JR100657# **ASX: Powering Australia's financial markets**# When you join ASX, you’re joining a company with a strong purpose – to power a stronger economic future by enabling a...

  • Lead Data Engineer

    3 days ago

    Council of the City of Sydney, Australia Wisr Finance Pty Full time

    Wisr is committed to building a supportive, inclusive and diverse workplace, and we strongly encourage applications from all backgrounds and identities. We’re happy to accommodate any reasonable adjustments to the interview process to ensure equal opportunity for all. If you require reasonable adjustments, please reach out to us via...