Building Large-Scale Data Systems

7 days ago

Sydney, New South Wales, Australia beBeeData Full time $115,000 - $155,000
Senior Data Engineer Position

We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in building and maintaining large-scale data processing systems, as well as a strong background in software engineering principles.

Key Responsibilities:
  • Data Ingestion: Design and implement efficient data ingestion pipelines to handle high-volume data streams from various sources.
  • Cloud Infrastructure: Manage and extend cloud infrastructure for data processing, currently running on GCP and managed with Terraform.
  • Collaboration: Work closely with scientists to optimize data processing workflows, delivering richer data at bigger scale and lower cost.
  • Dataset Roadmap: Collaborate with the AI Team and leadership to craft the dataset roadmap for next-generation consumer and enterprise products.
Requirements:
  • Education: BS/MS/PhD in Computer Science or related field.
  • Experience: 5+ years of industry experience in software development.
  • Skills: Proficiency with bash/Python scripting in Linux environments, Docker, and Infrastructure-as-Code concepts.
  • Cloud Provider: Professional experience with at least one major Cloud Provider (we use GCP).
  • Large-Scale Data Processing: Experience with web crawlers and large-scale data processing workflows is a plus.
  • Communication: Strong communication skills, both written and verbal.
Benefits:
  • Fast-Growing Environment: A fast-growing environment where you can help shape the company and product.
  • Entrepreneurial Culture: An entrepreneurial-minded team that supports risk, intuition, and hustle.
  • Autonomy: A hands-off management approach so you can focus and do your best work.
  • Impact: Opportunity to make a big impact in a transformative industry.
  • Competitive Compensation: Competitive salaries and a commitment to building a great asynchronous culture.
  • Innovative Products: Opportunity to work on life-changing products that millions of people use.

  • Large Scale Data System Architect

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time $150,000 - $200,000

    Our organization is seeking a highly skilled Large Scale Data Systems Specialist to fill a key role in our data systems team. In this position, you will design, build and maintain large-scale data systems to support business operations.Key Responsibilities:Design and develop data pipelines to integrate with various sourcesDevelop and maintain large-scale...

  • Large Scale Data Systems Specialist

    2 weeks ago

    Sydney, New South Wales, Australia Bebeedataengineer Full time

    Our organization is seeking a skilled Data Engineer to join our team. The role of the Staff Data Engineer involves designing, building, and maintaining large-scale data systems to support business operations.Key Responsibilities:Design and develop data pipelines to integrate with various sourcesDevelop and maintain large-scale data systems using distributed...

  • Senior Large Scale Data Architect

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time $180,000 - $200,000

    Large Scale Data System EngineerWe are seeking a highly skilled Large Scale Data System Engineer to join our team. As a key member of our high-performing group, you will play a pivotal role in shaping the operation of large-scale platforms.You will work with advanced distributed systems to process massive datasets and deliver actionable insights.Key...

  • System Engineer

    2 weeks ago

    Sydney, New South Wales, Australia beBeeSiteReliability Full time $142,999 - $214,999

    Job OverviewA key technical role, Site Reliability Engineering combines software and systems engineering to build and run large-scale, massively distributed, fault-tolerant systems.Much of our development focuses on optimizing existing infrastructure, building automation, and eliminating work through process improvements.As a technical leader in this field,...

  • Chief Architect for Large-Scale Data Systems

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $200,000 - $250,000

    Senior Director of Data EngineeringThis is a senior leadership role in our data engineering team. You will be responsible for designing and building large-scale data systems that meet the needs of our clients.Design and develop data pipelines using cutting-edge tools and technologiesImplement data mesh architectures to enhance client data interactionsDevelop...

  • Senior Large-Scale Data Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $180,000 - $200,000

    Job OverviewJob Title: Data EngineerWe are seeking a seasoned data engineer to join our team. As a key member of our data organization, you will be responsible for designing and implementing large-scale data systems, ensuring high-performance data processing, and collaborating with cross-functional teams to identify business needs and develop data...

  • Large Scale Data Management Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeDataStorage Full time $80,000 - $140,000

    Senior Data ArchitectThe role of Senior Data Architect involves leading the design and implementation of large-scale data storage systems to ensure their integrity, accessibility, and scalability.

  • Expert in Large-Scale Data Analytics Solutions

    1 week ago

    Sydney, New South Wales, Australia beBeeDataAnalytics Full time $120,000 - $180,000

    Senior Consultant: Large-Scale Data Analytics ExpertWe are seeking a highly skilled Senior Consultant to lead the development of innovative data analytics solutions in Sydney, Australia.The ideal candidate will have experience in designing and implementing large-scale data analytics systems using Azure technologies such as Synapse, OneLake, Data Factory, and...

  • Sre Leader For Large-Scale Systems

    2 weeks ago

    Sydney, New South Wales, Australia Bebeesite Full time

    About This RoleAs a Graduate Site Reliability Engineer, you'll have unparalleled opportunities to kickstart your career and explore limitless growth opportunities.Candidates can apply to multiple positions, and their applications will be reviewed on a rolling basis.About the JobThis role involves managing critical infrastructure systems across storage,...

  • Deliver Large-Scale Building Projects

    2 weeks ago

    Sydney, New South Wales, Australia beBeeBms Full time $130,000 - $180,000

    BMS Project ManagerWe are seeking a skilled BMS project manager to lead technically advanced and large-scale building projects.