Streaming Data Engineer
3 weeks ago
About the Role
Are you passionate about real-time data and cutting-edge streaming technologies? We’re looking for a Streaming Data Engineer to build and optimize high-performance data pipelines that process millions of events per second If you thrive in fast-paced environments and love solving complex challenges, this is the role for you.
What You’ll Do 🔥
- Architect, build, and optimize real-time data streaming pipelines using Kafka, Flink, Spark Streaming, or similar technologies.
- Design scalable, low-latency solutions to process massive volumes of data.
- Work closely with software engineers, data scientists, and DevOps teams to integrate streaming solutions into our platform.
- Monitor and enhance pipeline performance for fault tolerance, security, and efficiency.
- Implement data governance, compliance, and best practices in real-time data engineering.
What You Bring 💡
- Proven expertise in real-time data streaming and event-driven architectures.
- Strong hands‑on experience with Kafka, Flink, Spark Streaming, or similar technologies.
- Proficiency in Java, Scala, or Python for data engineering.
- Deep understanding of distributed computing, messaging systems, and cloud platforms (AWS, Azure, GCP).
- Familiarity with SQL and NoSQL databases for real‑time analytics.
- Experience with Docker, Kubernetes, and CI/CD pipelines is a plus
To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Yash Kumar Jain on 03 8680 4235 or email: ykumarjain@paxus.com.au and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
#J-18808-Ljbffr
-
Senior Data Engineer
2 weeks ago
Council of the City of Sydney, Australia ClearCompany Full timeDue a data modernisation program moving to Fabric, we are now looking for a Senior Data Engineer to join the business. The role of the Senior Data Engineer is responsible for designing, building, and maintaining the infrastructure that supports data storage, processing and retrieval. You will require proven experience working with large data sets and the...
-
Snowflake Data Engineer
4 days ago
Council of the City of Sydney, Australia Cognizant Full timeJob Summary We are seeking a highly experienced Data Engineer with expertise in Snowpark Snowflake Tasks Snowflake Streams Snowflake SQL and Snowpipe. The role is hybrid requiring a blend of remote and in-office work during day shifts. The ideal candidate will drive innovation and efficiency in data management processes contributing significantly to our...
-
Senior Data Engineer
2 weeks ago
Council of the City of Sydney, Australia Lifebyte Systems Full timeAt LifeByte, we are a dynamic and innovative collective of tech visionaries driven by a relentless pursuit of excellence. Each of us brings a unique set of skills to the table, collaborating on projects that shape the future. Founded in 2017, we are dedicated to fostering an ecosystem of seamless resource exchange, where efficiency and precision are...
-
Project Manager
1 week ago
City of Parramatta Council, Australia Michael Page Australia Full time- SAP S/4HANA - SAP data stream About Our Client This public sector organisation is a large and well-established entity dedicated to serving the community through innovation and excellence. With a focus on analytics, they are committed to delivering data-driven solutions that enhance operational efficiency. Job Description - Lead and manage data stream...
-
Senior Manager, Data Engineering
4 weeks ago
Council of the City of Sydney, Australia Mable Full timeOverview HomeMade, Mable, Leap in! and Mable Direct are entities under the Attain Healthtech Group of companies. While our companies are diverse, three similarities bind us: 1) We exist to create lasting, positive change across the entire care and support sector - impacting more lives, elevating standards and shaping the future of care; 2) We believe in...
-
Public Sector Data Stream Project Manager
4 days ago
City of Parramatta Council, Australia Michael Page Australia Full timeA prominent recruitment agency is seeking a Project Manager (Data Stream Lead) to lead data stream projects in the public sector. The role involves managing projects from initiation to completion, engaging with stakeholders, and ensuring data governance. Applicants should have strong project management and data analytics skills. This temporary role offers a...
-
Data Engineer
3 weeks ago
Council of the City of Sydney, Australia Atturra Limited Full timeWhat you’ll be doing Atturra Data & Integration are looking for a Lead / Senior Data Specialist to own the journey from legacy silos to a Unified Lakehouse on Databricks. You’ll be involved in discovery workshops, shape target architecture and be part of a high performing engineering team that turns raw data into trusted insight. Atturra is seeking...
-
Data Engineer
3 weeks ago
Council of the City of Sydney, Australia Lendaly Pty Full timeImprove upon existing systems that collect, manage and convert data for our teams to interpret in a meaningful way. Experience with building AI/ML models and rule-based engines required. Responsibilities - Design, build, and maintain scalable data pipelines to collect, process, and store large volumes of structured and unstructured data from various...
-
Senior Data Engineer
2 weeks ago
Council of the City of Sydney, Australia Infosys Limited Full timeAbout Us: Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 56 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the...
-
Data Solution Designer
1 week ago
Council of the City of Sydney, Australia Ambition Group Full timeJob Type: Contract (6 months likely extension) Salary: 750 per day We are seeking an experienced Data Solution Designer to lead our modern data platform, manage high-performing teams, and drive end-to-end delivery of enterprise analytics solutions. You will define strategy, implement scalable cloud‑native data platforms, and partner with business &...