Current jobs related to Data Infrastructure Specialist - Sydney, New South Wales - beBeeKafka

  • Infrastructure Data Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeData Full time $800 - $900

    Infrastructure Data SpecialistAs an Infrastructure Data Specialist, you will be responsible for managing and analysing data to identify opportunities across the infrastructure lifecycle.Key ResponsibilitiesAssist in planning quality management for data within the area of responsibility and for transformational digital projects.Analyse information structures...

  • Data Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia Bebeedatainfrastructure Full time

    Job Title: Data Infrastructure SpecialistWe are seeking a seasoned professional to design and implement scalable data storage systems, optimize data lake performance, and ensure smooth data workflows.Key Responsibilities:Data Lake Solutions: Implement and manage data lake solutions using Apache Iceberg for time-travel, schema evolution, and transaction...

  • Data Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeInfrastructure Full time $140,000 - $180,000

    Job Title We are seeking a Data Infrastructure Specialist to join our team. This role involves architecting and maintaining a hybrid on-premises and cloud-based data platform. The systems you build will ingest, store, and serve large amounts of financial data—reliably and with low latency. Your work will directly support trading, research, and...

  • Data Center Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time $55,000 - $93,000

    Job Title: Data Center Infrastructure SpecialistThis role requires a basic understanding of IT hardware and its configurations.Troubleshooting experience or knowledge of IT issues is necessary.About the Position:You will work with complex computing infrastructure, gaining hands-on experience in daily data center operations.Your tasks involve collaborating...

  • Data Center Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeEngineering Full time $99,000 - $124,995

    Job Title:Infrastructure Specialist - Data Center OperationsThis role is part of a global team responsible for designing, planning, delivering, and operating all data center infrastructure.Key Responsibilities:Review routine maintenance on critical systems like power distribution equipment, generators, and cooling systems.Establish performance benchmarks to...

  • Data Science Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia Bebeedatascience Full time

    Job Title:Data Science Infrastructure SpecialistThe successful candidate will design and implement scalable data pipelines, collaborate with cross-functional teams to integrate machine learning models into production, and ensure seamless deployment and monitoring of these models.Responsibilities:Develop Complex Data Pipelines:Utilize expertise in AWS...

  • Chief Data Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $180,000

    Job OverviewWe are seeking a skilled Chief Data Infrastructure Specialist to join our team.This individual will be responsible for designing and managing our enterprise data systems to ensure data accuracy, security, and accessibility across the business.Key ResponsibilitiesCreate scalable data solutions and support data governance initiatives.Develop and...

  • Chief Data Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia Bebeedata Full time

    Job OverviewWe are seeking a skilled Chief Data Infrastructure Specialist to join our team.This individual will be responsible for designing and managing our enterprise data systems to ensure data accuracy, security, and accessibility across the business.Key ResponsibilitiesCreate scalable data solutions and support data governance initiatives.Develop and...

  • It Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia Bebee Infrastructure Full time

    Infrastructure Engineer Role SummaryThis role is centered around delivering operational support across multiple HPE Aruba switching and wireless stacks, including switch and access point provisioning and troubleshooting.">Maintaining and supporting enterprise backup systems (e.g., NetBackup, Commvault) and associated processesProviding DNS and domain...

  • Data Infrastructure Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDatabase Full time $133,545 - $149,568

    Job Summary:">This is an exciting opportunity to contribute to our team as a Database Specialist. As a key member of the data engineering group, you will play a crucial role in designing and maintaining databases to support business growth and innovation.">About the Role:">">You will be responsible for ensuring the integrity, security, and performance of our...

Data Infrastructure Specialist

3 weeks ago

Sydney, New South Wales, Australia beBeeKafka Full time $130,000 - $150,000
Real-Time Data Architect

A seasoned data professional with expertise in designing and implementing real-time data pipelines is sought to spearhead the development of cutting-edge data systems.

This critical role involves collaborating closely with cross-functional teams to ensure the seamless integration of data pipelines, guaranteeing the performance, reliability, and scalability of our data infrastructure.

Key Responsibilities:
  • Design and engineer scalable, high-performance data pipelines leveraging Apache Kafka.
  • Develop and maintain efficient Kafka producer/consumer libraries.
  • Monitor and optimize Kafka clusters for maximum throughput, low latency, and fault tolerance.
  • Collaborate with research teams to integrate streaming data pipelines into existing workflows.
  • Implement robust access controls, authentication, and encryption mechanisms for secure data transmission.
  • Contribute to disaster recovery planning and ensure production stability through proactive monitoring and incident response.
  • Deliver high-quality data to S3 and support lakehouse ingestion strategies.
  • Document complex systems and share best practices in Kafka engineering across teams.
  • Stay up-to-date with emerging technologies and recommend strategic improvements.
Requirements:
  • Minimum 3+ years of experience in data engineering and architecture.
  • Hands-on expertise with Apache Kafka in production environments.
  • Thorough understanding of Kafka architecture, components, and deployment models.
  • Experience in deploying, scaling, and monitoring large-scale Kafka clusters.
  • Proficiency in Python, Java, Scala, or Bash programming languages.
  • Comfortable working in Linux environments and familiar with C++.
  • Good grasp of networking fundamentals and security best practices.