Senior Big Data Processing Specialist

5 days ago

Canberra, ACT, Australia beBeeDataEngineer Full time $119,741 - $142,498
Big Data Engineer Role

We seek an experienced engineer to work with large-scale data sets, utilizing Spark and Kafka.

  • Maintain and develop efficient data processing pipelines.
  • Ingest tables into our data lake from Kafka using various techniques.
  • Run jobs for ingestion, curation, and extraction of data.
  • Alter schemas and configs to meet business requirements and ensure data quality.
Your Key Responsibilities:
  • Collaborate with cross-functional teams to achieve successful data integration.
  • Troubleshoot and resolve bugs in the data processing pipelines.
  • Monitor performance and troubleshoot issues using logging and monitoring tools.
  • Document best practices and develop standards for data processing pipelines.
  • Stay up-to-date with emerging technologies and industry trends in big data processing and analytics.
Requirements:
  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
  • 3+ years of experience in data engineering, software development, or a related field.
  • Strong programming skills in Scala, Python, or Java.
  • Expertise in Spark, Kafka, and big data processing concepts.
  • Experience with data storage solutions and data serialization formats.
Benefits

A competitive compensation package, benefits, opportunities for growth and advancement within the company, challenging projects, skill development, and making a real impact on our business.

Your Essential Attributes:
  • Strong communication, problem-solving, and collaboration abilities.
  • Ability to work independently and in a team-oriented environment.

  • Big Data Solutions Architect

    6 days ago

    Canberra, ACT, Australia beBeeDataDriven Full time $108,759 - $183,996

    Transforming data into actionable insights is a key goal of our team. We work with top companies to advance their digital transformation by leveraging the power of big data.We are seeking an experienced professional who can design and implement large-scale storage and data centre solutions, as well as globally distributed platforms.The ideal candidate will...

  • Data Processing Specialist

    1 week ago

    Canberra, ACT, Australia beBeeDataProcessor Full time $80,000 - $110,000

    Job SummaryAs a Data Processing Specialist, you will play a key role in collecting and processing information from various sources, transforming it into high-quality data in multiple formats.This is an exciting opportunity to utilize your analytical skills and technical expertise to drive business outcomes and improve decision-making processes.The successful...

  • Senior SAP Data Engineer

    1 week ago

    Canberra, ACT, Australia NTT DATA Full time US$90,000 - US$120,000 per year

    Is innovation part of your DNA? Do you want to enable a connected future for people, organizations, and society?Join our growing global NTT team and you'll be part of the world's largest ICT company (by revenue). We've combined the capabilities of 28 remarkable companies to become one, leading technology services provider. Together, we help our people,...

  • Senior Data Insights Specialist

    6 days ago

    Canberra, ACT, Australia beBeeDataInsights Full time $94,332 - $103,731

    Senior Data Insights Specialist">Job Overview:">The Department of Employment and Workplace Relations is seeking an experienced Senior Data Insights Specialist to drive business outcomes through data-driven decision-making. The successful applicant will be responsible for analysing large datasets, identifying trends, and developing measures to enhance program...

  • Advanced Data Processing Specialist

    7 days ago

    Canberra, ACT, Australia beBeeDataProcessing Full time $93,019 - $141,467

    Job Title: Advanced Data Processing SpecialistAbout the Role:This position involves providing high-level technical expertise in data processing and management systems.Key Responsibilities:Collaborate with stakeholders to design solutions that meet business requirements.Develop functional specifications and design documentation for use cases.Analyse business...

  • Lead Data Analyst

    2 weeks ago

    Canberra, ACT, Australia NTT DATA Full time

    Lead Data Analyst - Baseline Security ClearanceNTT DATA Canberra, Australian Capital Territory, AustraliaOur client is looking for a seasoned specialist in the Microsoft industry and international customer relations to aid in a contract review and discovery initiative. The ideal candidate will be responsible for identifying and analyzing existing...

  • Senior Data Specialist

    7 days ago

    Canberra, ACT, Australia beBeeData Full time $100,000 - $140,000

    ">Senior Data Specialist Opportunity\We are seeking a highly skilled and experienced Senior Data Specialist to support our IT enhancement project, focusing on delivering critical enhancements to Microsoft Dynamics Customer Relationship Management (CRM) and associated NMI Services Portal as part of our digital strategy.\About the Project\Map existing data...

  • Senior Data Governance Specialist

    1 week ago

    Canberra, ACT, Australia beBeeDataGovernance Full time $100,000 - $140,000

    Job Title: Senior Data Governance SpecialistThis role is critical to the success of our organization, requiring expertise in Microsoft SQL Server, including SSAS, SSIS, T-SQL, and data performance tuning. The ideal candidate will have a strong understanding of data governance and compliance with relevant legislation.The Senior Data Governance Specialist will...

  • Senior Project Manager

    1 week ago

    Canberra, ACT, Australia Data#3 Full time $90,000 - $120,000 per year

    High-Impact Infrastructure Projects Voted HRD's Employer of Choice for the last 10 years. Culture built on Honesty, Excellence, Agility, Respect, and Teamwork (HEART). Join Data#3 as a Senior Project Manager and take the lead on high-impact infrastructure projects, including network modernisation, data centre rollouts, and end-user computing...

  • Senior Client Manager

    7 days ago

    Canberra, ACT, Australia Ntt Data, Inc. Full time

    OverviewSenior Talent Acquisition Specialist at Workforce Solutions, a division of NTT Ltd.In a constantly changing world, we work together with our people, clients and communities to enable them to fulfill their potential to do great things. We believe that by bringing everyone together, we can solve problems using innovative technology that can create a...