Data Engineer

22 hours ago

Council of the City of Sydney, Australia Imaginedata Full time

This role is responsible for the design and implementation of AUSTRAC Application Programming Interface (APIs) or key internal and external interfaces, primarily for the Reporting Entity System Transformation (REST) program. The design and implementation of these APIs are vital to the provision of high throughput as well as be intuitive for internal and external clients to use (e.g. follow best practice for documentation).

This role is also responsible for the co-ordination of the weekly release process, which delivers changes into the production environments. The Data Engineer will work collaboratively with management and across development teams to assist with the delivery and enhancement of new and existing projects.

Responsibilities and Requirements

The successful candidate will have the following skills:

- Degree in Computer Science or equivalent.
- Excellent development skills in Java and Scala.
- Extensive experience in building and documenting client facing interfaces (i.e. APIs) using the springboot framework.
- Hands on experience using parallel processing technologies including Apache Spark, Kafka and the Elastic stack (Kibana, Logstash, Elasticsearch).
- Experience in choosing & writing efficient processing algorithms.
- Ability to co-ordinate a release across a medium sized team, including release documentation for sign off.
- Ability to write complex and optimized queries against both SQL and NoSQL data stores.
- Previous experience with containerisation tools and processes.
- An understanding of Continuous Delivery techniques and tools (including Jenkins).
- Knowledge of the methodology used by the DTA.

#J-18808-Ljbffr

  • Data Engineer

    21 hours ago

    Council of the City of Sydney, Australia GrainCorp Full time

    Overview GrainCorp is currently seeking a Data Engineer to join a motivated and collaborative team delivering data, infrastructure, and system activities to support advanced analytic use cases. You’ll have the opportunity to work from multiple exciting AI and IoT projects and be trained by experts who’ve been in this space for...

  • Data Engineer

    1 week ago

    Council of the City of Sydney, Australia Zone IT Solutions Full time

    Overview We are currently seeking a highly motivated and experienced Data Engineer for a full-time position. You will be responsible for designing and implementing data architectures, integrating data from various sources, and optimizing data pipelines to ensure efficient and accurate data processing. Responsibilities - Design and implement data...

  • Azure Data Engineer

    2 weeks ago

    Council of the City of Sydney, Australia HSO Enterprise Solutions GmbH Full time

    Overview As an Azure Data Engineer you can expect to… - Design, build, and maintain data engineering solutions on Microsoft Azure and Fabric (Lakehouse, Warehouse, Data Factory, Synapse Analytics, Dataflows, Eventstreams). - Coordinate sprints, daily stand-ups, and retrospective meetings as part of Agile delivery. - Collaborate with business and...

  • Data Analytics Engineer

    3 days ago

    Council of the City of Sydney, Australia ASX Full time

    Data Analytics Engineer page is loaded## Data Analytics Engineerremote type: Hybridlocations: Sydneytime type: Full timeposted on: Posted Todayjob requisition id: JR100650# **ASX: Powering Australia's financial markets**# When you join ASX, you’re joining a company with a strong purpose – to power a stronger economic future by enabling a fair...

  • Data Engineering Team Lead

    2 weeks ago

    Council of the City of Sydney, Australia DroneTalks Full time

    DroneShield is seeking someone to join the team as a Data Engineering Team Lead. About DroneShield: Work with cutting edge technology, making the world a safer and more secure place. DroneShield (ASX:DRO) offers an opportunity to solve some of the world’s most challenging technical problems in the Electronic Warfare, Artificial Intelligence and Machine...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia NTT DATA Full time $80,000 - $140,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Engineer...

  • Data Engineer

    1 week ago

    Sydney, New South Wales, Australia Data#3 Full time $120,000 - $150,000 per year

    3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...

  • Junior Data Engineer

    1 week ago

    Council of the City of Sydney, Australia GrainCorp Full time

    Overview GrainCorp is currently seeking 2 Junior Data Engineers to join our team at our Barangaroo office. This role will work with a motivated and collaborative team to deliver data, infrastructure and platform activities to support advanced analytical use cases and reporting success. The responsibilities of the role include: - Transform design and...

  • Data Engineering- Technical manager

    3 days ago

    Council of the City of Sydney, Australia Centelonsolutions Full time

    Centelon is a modern, young technology company that carries an unflinching passion to help clients innovate, adapt and succeed. We are a business-technology products, solutions and services company. At Centelon, we harness the power of AI, digital and other emerging technologies to help our clients adapt to the evolving world. Centelon is a trusted partner...

  • Junior Data Engineer

    1 week ago

    Council of the City of Sydney, Australia Transform SR Brands Full time

    Overview We’re hiring a Junior Data Engineer / BI Developer to join our team working across the Microsoft data stack. You’ll start with Power BI reporting and data modelling and grow into building data pipelines, warehouses, and lakes. You will get exposure to enterprise systems such as Dynamics 365 and Microsoft Fabric. This role suits someone with a...