Senior Data Processing Specialist

1 week ago

Sydney, New South Wales, Australia beBeeData Full time $150,000 - $180,000
Job Title: Data Engineer

We are seeking a seasoned professional to join our enterprise data platforms team.

About the Assignment

This is an opportunity to apply your expertise in large-scale data processing and contribute to a significant digital transformation initiative.

Key Responsibilities:

  • Design and build robust and scalable data pipelines for migration to AWS Glue.
  • Migrate existing custom data frameworks (e.g., Spark) to the new AWS Glue platform.
  • Work with multiple data clusters, including Starburst Presto and Spark, to ensure smooth data flow.
  • Implement Big Data processing solutions using technologies such as Hive, Spark, and Starburst Presto.
  • Collaborate with cross-functional teams to deliver project outcomes in a fast-paced Agile and DevOps environment.

Requirements:

  • 5-7+ years of enterprise experience as a Data Engineer.
  • Demonstrated hands-on experience with AWS cloud platforms and services, including S3, EKS, and Redshift.
  • Strong scripting skills in Python and/or Bash.
  • Experience in a DevOps, Agile, Scrum, or Continuous Delivery environment.
  • Experience with big data technologies such as Spark, Starburst Presto, and Hive.
  • Excellent communication and interpersonal skills.

Benefits:

  • Contribute to a major migration project.
  • Opportunity to work with multiple data clusters.
  • Collaborative and dynamic work environment.

Note:

Only shortlisted candidates will be contacted.

We are an equal opportunity employer committed to a diverse and inclusive workplace.

  • Senior Data Processing Specialist

    6 days ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $240,000

    We're seeking a skilled Data Processing Specialist to join our team.Key Qualifications:Demonstrated expertise in distributed data processing using Python, SQL, Spark, and Scala.Proven experience with cloud-based data platforms, including AWS Glue, Lambda, Redshift, Athena, Kinesis, and EMR.Familiarity with data monetization strategies and API Gateway.Nice to...

  • Data Processing Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataProcessing Full time $60,000 - $80,000

    Data Processing SpecialistWe are seeking a skilled Data Processing Specialist to join our team. The successful candidate will be responsible for accurately processing high volumes of data and maintaining attention to detail.The role involves:Entering data into our systems with precisionTracking orders throughout the purchasing processProviding excellent...

  • Senior Data Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeData Full time $102,824 - $208,684

    Job Title: Senior Data SpecialistAbout the RoleThis is a senior-level position that requires both technical expertise and business acumen.The ideal candidate will have experience in designing and delivering scalable, high-performance data solutions across on-premises and cloud environments.Key Responsibilities:Develop and implement end-to-end data...

  • Senior Data Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $180,000

    Job Title: Senior Data SpecialistWe are seeking a seasoned professional to oversee the development, deployment, and maintenance of large-scale data pipelines in Azure.Key Responsibilities:Design, build, and maintain ETL pipelines using Databricks and Spark SQL to ensure efficient data transformation and analysis.Optimize SQL queries for large-scale data...

  • Senior Data Engineering Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineering Full time $170,000 - $200,000

    Job Title: Senior Data Engineering SpecialistWe are seeking a highly skilled and experienced Senior Data Engineering Specialist to join our team. This individual will be responsible for designing, building, and optimizing data pipeline solutions on Databricks and related cloud platforms.Key Responsibilities:Collaborate with data scientists, analysts, and...

  • Senior Data Processing Lead

    7 days ago

    Sydney, New South Wales, Australia beBeeCloud Full time $120,000 - $150,000

    Senior Data Processing LeadJob OverviewA senior developer position is available to lead the engineering team in data processing and analysis. This key role involves providing technical guidance and oversight to ensure high-quality solutions are delivered. The successful candidate will be responsible for maintaining development standards and best practices,...

  • Senior Data Processing Specialist

    2 weeks ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $100,000 - $130,000

    About the RoleThis is a key position that combines the responsibilities of a Data Analyst and a Data Engineer.The role will require an extremely creative individual with a strong understanding of the end-to-end data process. This includes acquiring data from source systems, transforming data to meet business needs, and visualising and analysing data to...

  • Senior Data Privacy and Compliance Specialist

    1 week ago

    Sydney, New South Wales, Australia beBeeDataPrivacy Full time $125,000 - $130,000

    Job Title:Senior Data Privacy and Compliance Specialist">Key Responsibilities:As a Senior Data Privacy and Compliance Specialist, you will be responsible for managing the company's data privacy and compliance program across multiple business lines. This includes developing and implementing policies and procedures to ensure compliance with global data privacy...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data#3 Full time

    Overview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...

  • Senior Data Analytics Specialist

    5 days ago

    Sydney, New South Wales, Australia Bebeecloud Full time

    Unlock new possibilities with our expert team as a Senior Data Analytics Specialist.We are seeking an experienced professional to join our dynamic team, where you will be responsible for designing and implementing cutting-edge data analytics solutions that drive business growth and innovation.About the RoleThis is an exciting opportunity to work on...