Senior Big Data Infrastructure Specialist

2 weeks ago

Brisbane, Queensland, Australia beBeeDataInfrastructureEngineer Full time $100,000 - $150,000

We are seeking a seasoned data infrastructure engineer to join our team. The ideal candidate will have expertise in designing and improving central big data infrastructure/services to ensure reliability, fault-tolerance, scalability, and cost-effectiveness.

The successful candidate will engage in the whole lifecycle of service development, from inception and design through to deployment, operation, and refinement. They will also develop and maintain tools, redesign capacity planning infrastructure for greater scalability, troubleshoot and diagnose software issues, and ensure data security.

Key responsibilities include:

  • Developing and maintaining production LLM systems to power business functions
  • Optimizing and supporting LLM workloads in on-prem environments

Requirements for this role include:

  • Strong understanding of open-source data groups such as HDFS, HBase, YARN, Spark, Flink, Airflow, Kyuubi, ZK, and Kafka
  • Expertise in Linux and computer networks
  • Proficiency in at least one language (Python/Golang/Java)
  • Experience in profiling, benchmarking, and optimizing ML applications
  • Self-directed, self-motivated, and detail-oriented with ability to come up with good design proposals and thorough analysis of production issues
  • Ability to thrive in a multi-functional team on high-profile, critical projects
  • Minimum of 5 years of hands-on experience in backend or big data ecosystem
  • Comfortable working in a high-velocity startup environment with evolving goals and systems

  • Big Data Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeDataEngineering Full time $120,000 - $150,000

    Job OverviewThis position plays a key role in developing and maintaining efficient data pipelines, ensuring the smooth operation of our company's systems. The successful candidate will have expertise in big data technologies and frameworks, with a strong focus on delivering high-quality results.Key ResponsibilitiesDesign, build, and maintain efficient data...

  • Senior Infrastructure Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeInfrastructure Full time $100,000 - $130,000

    Job DescriptionWe are seeking a skilled Infrastructure Specialist to implement, manage and retire infrastructure that supports digital services. This role requires in-depth knowledge of ICT platforms to provide expert advice on the management and maintenance of those platforms.ResponsibilitiesDesign and evaluate infrastructure requirements to meet future...

  • Data Infrastructure Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeInfrastructure Full time $70,000 - $78,000

    Technical Infrastructure SpecialistThe role of Technical Infrastructure Specialist is a key position that requires the individual to oversee the health, reliability, and stability of data technical infrastructure. This leadership position demands extensive experience in technology, preferably within the financial services sector, and proven leadership skills...

  • Data Infrastructure Specialist

    1 week ago

    Brisbane, Queensland, Australia beBeeEngineer Full time $104,220 - $183,540

    Software Engineer RoleThis role involves developing scalable and secure data infrastructure, partnering with product and infra teams to capture meaningful signals across services, supporting shared tooling and pipelines for model training, evaluation, and deployment, releasing frequent updates every week.We are looking for a highly motivated individual with...

  • Senior Infrastructure Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeInfrastructure Full time $80,000 - $110,000

    Job Title: Senior Infrastructure SpecialistOverviewAs a Graduate Civil Engineer, you will contribute to the design and development of water supply systems, sewerage networks, and recycled water infrastructure.Key ResponsibilitiesConduct planning studies to identify infrastructure interventions required for growing populations.Analyse hydraulic network models...

  • Senior Infrastructure Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeInfrastructure Full time $80,000 - $120,000

    Job Title:A Senior Infrastructure Specialist is required to design, implement, and maintain data centre and infrastructure solutions across a diverse regional environment.Main Responsibilities:Design and deliver infrastructure solutions for data centre environmentsCollaborate with teams to support project delivery and operational improvementsProvide...

  • Senior Infrastructure Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeInfrastructure Full time $91,000 - $119,000

    About the RoleWe are seeking a Senior Infrastructure Specialist to support the governance and delivery of our infrastructure agreements.This role requires someone equally comfortable engaging directly with stakeholders and working with operational teams to track, assess and help manage works, risks and performance.Take a lead role in managing contract...

  • Big Data Architectural Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeEngineer Full time $140,000 - $200,000

    Job OverviewDatabricks is a data and AI company that creates a unified platform to solve complex data challenges.This role involves collaborating with customers to provide technical and business value in their assigned territory. The goal is to demonstrate the Data Intelligence Platform's capabilities through hands-on evaluation and Spark programming,...

  • Technical Lead for Big Data and MySQL Solutions

    1 week ago

    Brisbane, Queensland, Australia beBeeEngineering Full time $180,000 - $240,000

    About the RoleWe are seeking a skilled Technical Lead to lead teams focused on developing scalable data solutions for Kubernetes and cloud machines.Lead a team building high-performance data solutions for large-scale applications.Hire, coach, mentor, provide feedback, and lead by example.Demonstrate sound engineering skills by directly contributing code when...

  • Senior Infrastructure Specialist

    2 weeks ago

    Brisbane, Queensland, Australia beBeeInfrastructure Full time $95,000 - $125,000

    Job DescriptionWe are seeking a Senior Infrastructure Specialist, who will be working closely with the Manager, Infrastructure to develop and implement infrastructure capital and maintenance programs and projects.This role will involve supporting the development of asset management plans & asset registers, program budgets, campus master plans and project...