Streaming Data Engineer

3 weeks ago


Council of the City of Sydney, Australia Paxus - Technology + Digital Talent Full time

About the Role

Are you passionate about real-time data and cutting-edge streaming technologies? We’re looking for a Streaming Data Engineer to build and optimize high-performance data pipelines that process millions of events per second If you thrive in fast-paced environments and love solving complex challenges, this is the role for you.

What You’ll Do 🔥

- Architect, build, and optimize real-time data streaming pipelines using Kafka, Flink, Spark Streaming, or similar technologies.
- Design scalable, low-latency solutions to process massive volumes of data.
- Work closely with software engineers, data scientists, and DevOps teams to integrate streaming solutions into our platform.
- Monitor and enhance pipeline performance for fault tolerance, security, and efficiency.
- Implement data governance, compliance, and best practices in real-time data engineering.

What You Bring 💡

- Proven expertise in real-time data streaming and event-driven architectures.
- Strong hands‑on experience with Kafka, Flink, Spark Streaming, or similar technologies.
- Proficiency in Java, Scala, or Python for data engineering.
- Deep understanding of distributed computing, messaging systems, and cloud platforms (AWS, Azure, GCP).
- Familiarity with SQL and NoSQL databases for real‑time analytics.
- Experience with Docker, Kubernetes, and CI/CD pipelines is a plus

To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Yash Kumar Jain on 03 8680 4235 or email: ykumarjain@paxus.com.au and quote the above job reference number.

Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.

#J-18808-Ljbffr


  • Senior Data Engineer

    2 weeks ago


    Council of the City of Sydney, Australia ClearCompany Full time

    Due a data modernisation program moving to Fabric, we are now looking for a Senior Data Engineer to join the business. The role of the Senior Data Engineer is responsible for designing, building, and maintaining the infrastructure that supports data storage, processing and retrieval. You will require proven experience working with large data sets and the...


  • Council of the City of Sydney, Australia Cognizant Full time

    Job Summary We are seeking a highly experienced Data Engineer with expertise in Snowpark Snowflake Tasks Snowflake Streams Snowflake SQL and Snowpipe. The role is hybrid requiring a blend of remote and in-office work during day shifts. The ideal candidate will drive innovation and efficiency in data management processes contributing significantly to our...

  • Senior Data Engineer

    2 weeks ago


    Council of the City of Sydney, Australia Lifebyte Systems Full time

    At LifeByte, we are a dynamic and innovative collective of tech visionaries driven by a relentless pursuit of excellence. Each of us brings a unique set of skills to the table, collaborating on projects that shape the future. Founded in 2017, we are dedicated to fostering an ecosystem of seamless resource exchange, where efficiency and precision are...

  • Project Manager

    1 week ago


    City of Parramatta Council, Australia Michael Page Australia Full time

    - SAP S/4HANA - SAP data stream About Our Client This public sector organisation is a large and well-established entity dedicated to serving the community through innovation and excellence. With a focus on analytics, they are committed to delivering data-driven solutions that enhance operational efficiency. Job Description - Lead and manage data stream...


  • Council of the City of Sydney, Australia Mable Full time

    Overview HomeMade, Mable, Leap in! and Mable Direct are entities under the Attain Healthtech Group of companies. While our companies are diverse, three similarities bind us: 1) We exist to create lasting, positive change across the entire care and support sector - impacting more lives, elevating standards and shaping the future of care; 2) We believe in...


  • City of Parramatta Council, Australia Michael Page Australia Full time

    A prominent recruitment agency is seeking a Project Manager (Data Stream Lead) to lead data stream projects in the public sector. The role involves managing projects from initiation to completion, engaging with stakeholders, and ensuring data governance. Applicants should have strong project management and data analytics skills. This temporary role offers a...

  • Data Engineer

    3 weeks ago


    Council of the City of Sydney, Australia Atturra Limited Full time

    What you’ll be doing Atturra Data & Integration are looking for a Lead / Senior Data Specialist to own the journey from legacy silos to a Unified Lakehouse on Databricks. You’ll be involved in discovery workshops, shape target architecture and be part of a high performing engineering team that turns raw data into trusted insight. Atturra is seeking...

  • Data Engineer

    3 weeks ago


    Council of the City of Sydney, Australia Lendaly Pty Full time

    Improve upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required. Responsibilities - Design, build, and maintain scalable data pipelines to collect, process, and store large volumes of structured and unstructured data from various...

  • Senior Data Engineer

    2 weeks ago


    Council of the City of Sydney, Australia Infosys Limited Full time

    About Us: Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 56 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the...


  • Council of the City of Sydney, Australia Ambition Group Full time

    Job Type: Contract (6 months likely extension) Salary: 750 per day We are seeking an experienced Data Solution Designer to lead our modern data platform, manage high-performing teams, and drive end-to-end delivery of enterprise analytics solutions. You will define strategy, implement scalable cloud‑native data platforms, and partner with business &...