Advanced Data Developer

7 days ago

Sydney, New South Wales, Australia beBeeDataDeveloper Full time $75,000 - $85,000
Job Description

We are seeking a highly skilled and experienced data developer to join our team.

The ideal candidate will have strong expertise in building and maintaining robust, scalable, and high-performance big data solutions using modern big data tools and technologies.

You will be responsible for developing data pipelines, transforming large volumes of data, and optimizing data infrastructure to enable real-time and batch processing for business insights and analytics.

Mandatory Skills
  • Design, develop, and maintain scalable and secure big data processing systems using tools like Apache Spark, Hadoop, Hive, Kafka, etc.
  • Build and optimize data pipelines and architectures for data ingestion, processing, and storage from diverse sources (structured, semi-structured, unstructured).
  • Develop ETL/ELT workflows and data transformation logic using custom code in Python, Scala, Java, and job scheduling tools such as Control-M.
  • Translate business needs into technical specifications, develop application strategy, and high-level design documentation.
  • Involve in solution design discussions, competitive displacement, proof-of-concept engagements, solution demonstrations, and technical workshops.
Mandatory Knowledge & Qualifications
  • Bachelor's or master's degree in computer science, data engineering, information technology, or related fields.
  • 4+ years of experience in Big Data technologies.
  • Strong programming skills in Python, Scala, Shell Scripting, and Java.
  • Extensive experience in data transformation and building ETL pipelines using PySpark.
Primary Skills
  • Hadoop - Expert
  • Apache Spark - Expert
  • Apache Atlas - Expert
  • Python - Expert
  • Scala - Expert
  • Shell Script - Expert
  • PySpark - Expert
  • Scikit-learn - Expert
  • Matplotlib - Expert
  • Azure Storage Explorer - Expert

Key Responsibilities:

  • Manage development sprints effectively and efficiently from planning to execution to review in an agile development environment.
  • Convert business knowledge into technical knowledge and vice versa and able to translate those insights into effective frontline action.
  • Report and update management about the issues/blockers on time to mitigate risk.
  • Collaborate with different teams, analysts, and stakeholders to understand data requirements and deliver efficient data solutions.

  • Power BI Developer

    3 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    OverviewWe are seeking a skilled Power BI Developer to join a global leader in the travel and business services industry on a contract basis. In this role, you will play a key part in shaping global sales and account management dashboards, providing commercial leaders with the insights they need to manage teams, achieve KPIs and drive revenue growth.You will...

  • Power BI Developer

    3 days ago

    Sydney, New South Wales, Australia Data#3 Full time

    OverviewWe are seeking a skilled Power BI Developer to join a global leader in the travel and business services industry on a contract basis. In this role, you will play a key part in shaping global sales and account management dashboards, providing commercial leaders with the insights they need to manage teams, achieve KPIs and drive revenue growth.You will...

  • Advanced Data Systems Developer

    3 days ago

    Sydney, New South Wales, Australia beBeeSoftware Full time $114,000 - $123,000

    Join a team of talented engineers to develop and support software components that underpin the capabilities of the Australian SKA Regional Centre.Job DescriptionThis is an exciting opportunity for a skilled Software Engineer to join our dynamic team at the Australian SKA Regional Centre. We are looking for someone who can contribute to the design and...

  • Advanced Data Analyst

    2 days ago

    Sydney, New South Wales, Australia beBeeData Full time $100,000 - $150,000

    Job OpportunityA talented Data Scientist is sought to join a dynamic team and help solve real-world business problems using advanced data science and cloud-native technologies.As a Data Scientist, you will work across diverse datasets, build scalable tools, and deploy machine learning solutions leveraging AWS services.You'll play a vital role in driving...

  • Advanced Data Professional

    2 days ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $180,000

    As a skilled data professional, we are looking for an experienced AWS Data Engineer to join our team.We require a minimum of 3 years of experience in the field of AWS Data Engineering.The ideal candidate will have proven expertise in working with AWS data services such as Glue, Athena, and Redshift.A solid understanding of coding languages including Java,...

  • Advanced Data Strategist

    2 days ago

    Sydney, New South Wales, Australia beBeeData Full time $180,000 - $200,000

    We are seeking a highly skilled Principal Data Scientist to lead the development and integration of data science capabilities across R&D. The ideal candidate will have a proven track record of innovation, technical expertise in machine learning and statistical methods, and experience managing collaborative research and data infrastructure projects.   The...

  • Advanced Data Solutions Developer

    2 days ago

    Sydney, New South Wales, Australia beBeeSoftware Full time $114,000 - $123,000

    The Australian Square Kilometre Array Observatory (SKAO) is a significant international project. To support the vast data output from these instruments, SKAO is working with national SKA Regional Centres (SRCs). The Australian SKA Regional Centre (AusSRC) delivers data infrastructure and tools to the astronomy community.Key ResponsibilitiesDevelop software...

  • Advanced Data Insights Professional

    3 days ago

    Sydney, New South Wales, Australia beBeeData Full time $150,000 - $200,000

    Lead Data AnalystSkillfully drive business growth through strategic data-driven insights as a Lead Data Analyst. Develop and implement advanced analytical models to enhance customer experiences.Utilize machine learning techniques to generate predictive models for strategic decision making.

  • Data Scientist

    2 days ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $180,000

    Advance Your Data Science CareerWe are a premier data science team committed to staying at the forefront of emerging technologies.This full-time role offers a unique opportunity to contribute to state-of-the-art data science models that enhance user experiences for millions.Key Highlights:Collaborate with an experienced team to develop cutting-edge data...

  • Advanced Data Engineering Specialist

    24 hours ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $80,000 - $150,000

    Data Engineer RoleThis role is for a Data Engineer who can help us build a robust data environment to support business decision-making. The ideal candidate will have strong SQL skills and experience in big data engineering using Python.Key ResponsibilitiesCreate data visualisations and reportsWrite data feeds to collect information from external...