High-Performance Big Data Specialist

2 days ago

Sydney, New South Wales, Australia beBeeBigData Full time $75,000 - $85,000
Expert Big Data Developer Wanted

We are seeking a seasoned Big Data Developer to spearhead the design and implementation of robust, scalable big data solutions. The ideal candidate will have extensive expertise in building and maintaining high-performance big data systems using modern tools and technologies.

Key Responsibilities
  • Develop and optimize complex data pipelines and architectures for data ingestion, processing, and storage from diverse sources.
  • Design, develop, and maintain secure big data processing systems using tools like Apache Spark, Hadoop, Hive, and Kafka.
  • Translate business requirements into technical specifications, develop application strategies, and create high-level design documentation.
Requirements
  • Bachelor's or master's degree in computer science, data engineering, information technology, or related fields.
  • 4+ years of experience in Big Data technologies.
  • Strong programming skills in Python, Scala, Shell Scripting, and Java.
  • Extensive experience in data transformation and building ETL pipelines using PySpark.
Preferred Skills
  • Hadoop – Expert
  • Apache Spark – Expert
  • Apache Atlas – Expert
  • Python – Expert
  • Scala – Expert
  • Shell Script – Expert
  • PySpark – Expert
  • Scikitlearn – Expert
  • Matplotlib – Expert

The successful candidate will have a strong understanding of big data technologies, excellent problem-solving skills, and the ability to work collaboratively as part of a team. If you are a motivated and experienced Big Data Developer looking for a new challenge, please submit your application today.

  • Big Data Specialist

    1 day ago

    Sydney, New South Wales, Australia beBeedata Full time $120,000 - $180,000

    Job Title: Big Data SpecialistAbout the Role:We are seeking an experienced professional with a strong background in designing, building, and maintaining scalable data pipelines and workflows on the Databricks platform.Key Responsibilities:

  • Big Data Specialist

    6 hours ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $102,899 - $121,317

    Cloud Data EngineerWe are seeking a highly skilled and experienced Cloud Data Engineer to join our vibrant Engineering team in Sydney.The ideal candidate will have experience with cloud-based data platforms and commercial experience in programming languages such as Python, Java, or Scala. Additionally, proficiency in Spark SQL, ETL frameworks, Big Data...

  • High-Performance Engineering Lead

    7 days ago

    Sydney, New South Wales, Australia beBeePerformance Full time $101,232 - $102,031

    Performance Optimization SpecialistWe are seeking a highly skilled Performance Engineer to collaborate with our cross-functional teams to implement performance tuning solutions for cloud and in-house applications.About the Role:This is a unique opportunity to join our organization as a Performance Optimization Specialist. In this role, you will be...

  • Big Data Developer

    6 days ago

    Sydney, New South Wales, Australia Cognizant Full time

    Join to apply for the Big Data Developer role at Cognizant1 day ago Be among the first 25 applicantsJoin to apply for the Big Data Developer role at CognizantPosition SummaryWe are seeking a highly skilled and experienced Big Data Developer to join our engineering team. The ideal candidate will have strong expertise in building and maintaining robust,...

  • Big Data Architect

    2 days ago

    Sydney, New South Wales, Australia beBeeData Full time

    Big Data Architecture ExpertWe are seeking a talented professional to join our fast-paced AI team as a Big Data Architecture Expert. As part of this role, you will be responsible for designing and developing large-scale data architectures that support machine learning and artificial intelligence model training, validation, testing, and production.Key...

  • High-Performance Data Strategist

    1 day ago

    Sydney, New South Wales, Australia beBeeDataConsultant Full time $180,000 - $210,000

    Senior Consultant RoleThis dynamic role focuses on building real-time data pipelines and implementing data mesh architectures to enhance client data interactions.Key Responsibilities:Design & Architecture: Design scalable solutions using Databricks Lakehouse Architecture, applying best practices around Delta Lake, data modeling, and distributed processing to...

  • High-Performance Specialist

    7 days ago

    Sydney, New South Wales, Australia beBeePerformance Full time $101,232 - $102,031

    About the RoleJob OverviewWe are seeking a highly skilled Performance Tester to join our team. As a Performance Tester, you will be responsible for designing, developing, and executing performance test plans and test cases for Big Data, Payments solutions, and multi-cloud applications.Main Responsibilities:Develop non-functional requirements for new and old...

  • High-Level Data Specialist

    1 day ago

    Sydney, New South Wales, Australia beBeeData Full time $90,000 - $100,000

    Job Title: High-Level Data SpecialistAbout the RoleWe are seeking a skilled data specialist to join our team as a high-level expert in designing, developing, and implementing large-scale data systems.The ideal candidate will have extensive experience in modern data engineering methods, including Databricks Lakehouse Architecture, Delta Lake, and distributed...

  • Senior Big Data Specialist

    5 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $120,000 - $180,000

    Job OverviewWe are seeking a highly motivated professional to collaborate with the business and fellow engineers to design and implement data-driven solutions using big data technologies.Key ResponsibilitiesExpert level core Python development skills, including hands-on coding with production-grade systems.Strong understanding of PySpark/ Spark technologies,...

  • High-Performance Systems Specialist

    3 days ago

    Sydney, New South Wales, Australia beBeePerformanceEngineer Full time $101,232 - $102,031

    Job Title: Performance EngineerWe are seeking a highly skilled Performance Engineer to collaborate with our team in designing, developing, and executing performance test plans and test cases.About the RoleThis is an exciting opportunity to leverage your technical expertise in performance testing and optimization of complex systems, including Big Data,...