Data Specialist

2 weeks ago

Canberra, ACT, Australia beBee Careers Full time $100,000 - $150,000

We are seeking a Data Engineer with experience in Spark and Kafka to operate with one of our large Federal Government Clients.

Responsibilities:
  • Maintain and develop Spark pipelines to process large-scale data sets.
  • Ingest tables into our data lake from Kafka using batch processing, micro-batching, or real-time processing techniques.
  • Run Spark jobs for ingestion, curation, and extraction of data.
  • Alter schemas and configs to meet business requirements and ensure data quality.
  • Attend meetings regarding data ingestion and collaborate with cross-functional teams to ensure successful data integration.
  • Troubleshoot and resolve bugs in the data processing pipelines.
  • Monitor performance and troubleshoot issues using logging and monitoring tools.
  • Document best practices and develop standards for data processing pipelines.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
  • 3+ years of experience in data engineering, software development, or a related field.
  • Strong programming skills in Scala, Python, or Java.
  • Expertise in Spark, Kafka, and big data processing concepts.
  • Experience with data storage solutions, such as Hadoop HDFS or Amazon S3, and data serialization formats.
  • Knowledge of database concepts, data modelling, schema design, and normalisation.
  • Familiarity with monitoring and logging tools, and workflow management tools, such as Apache Airflow.
  • Experience with version control systems, such as Git.
Your Attributes:
  • Strong communication, problem-solving, and collaboration abilities.
  • Ability to work independently and in a team-oriented, collaborative environment.

Suitable candidates must have a Baseline (NV1 preferred) Security Clearance.

  • Lead Data Analyst

    2 weeks ago

    Canberra, ACT, Australia NTT DATA Full time

    Lead Data Analyst - Baseline Security ClearanceNTT DATA Canberra, Australian Capital Territory, AustraliaOur client is looking for a seasoned specialist in the Microsoft industry and international customer relations to aid in a contract review and discovery initiative. The ideal candidate will be responsible for identifying and analyzing existing...

  • Data Operations Specialist

    2 weeks ago

    Canberra, ACT, Australia beBeeData Full time $80,000 - $120,000

    Job Title: Data Operations SpecialistWe are seeking a skilled and experienced Data Operations Specialist to join our team. This role is ideal for someone who enjoys working with data, has strong analytical skills, and can communicate complex ideas effectively.About the Role:The Data Operations Specialist will be responsible for deploying software solutions...

  • Security Compliance Specialist

    1 week ago

    Canberra, ACT, Australia Cdc Data Centres Full time

    **About us**:Established in 2007, CDC Data Centres is Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW and New Zealand, CDC's diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute...

  • Data Entry Specialist

    7 days ago

    Canberra, ACT, Australia beBeedataentry Full time $90,000 - $110,000

    Data Entry Specialist Job OpportunityWe are seeking an experienced data entry specialist to join our team on a six-month contract. The successful candidate will be responsible for reviewing and transferring large amounts of detailed data across different IT platforms.

  • Data Insights Specialist

    7 days ago

    Canberra, ACT, Australia beBeeData Full time $70,000 - $100,000

    Job Opportunity: Data Insights Specialist\We are seeking an experienced professional to join our team as a Data Insights Specialist on a 12-month contract with the possibility of extension.\

  • Data Management Specialist

    1 week ago

    Canberra, ACT, Australia beBeeDataManagement Full time $118,549 - $144,065

    Job Title: Data Management SpecialistAt our organization, we are enhancing transparency and accountability by deterring, detecting and preventing corrupt conduct. Our work involves education, monitoring, investigation, reporting and referral.This is an exciting opportunity to contribute to our team as we establish robust systems and processes, deliver...

  • Data Automation Specialist

    1 week ago

    Canberra, ACT, Australia beBeeData Full time $129,120 - $145,990

    Job TitleOur organization seeks a highly skilled and experienced Data Automation Specialist to enhance the data integration, analysis, and visualization capabilities within our agency.Job DescriptionThe successful candidate will possess a unique blend of technical mastery and strategic thinking, thriving in a dynamic and highly secure environment. They will...

  • Data Collection Specialist

    1 week ago

    Canberra, ACT, Australia beBeeGeology Full time $55,000 - $82,000

    **Data Collection Specialist**: We are seeking a detail-oriented professional to fill a Data Collection Specialist role. This is an exciting opportunity in the field of earth science.**Key Responsibilities:**Analyse data from structured and unstructured reports to identify patterns and trends.Enter data into databases for geological samples, boreholes,...

  • Data Insight Specialist

    2 weeks ago

    Canberra, ACT, Australia beBeeData Full time $98,765 - $123,456

    Job Opportunity:Data Insight SpecialistWe are seeking a skilled Data Insight Specialist to join our team and play a pivotal role in the transition from legacy data solutions to cloud-based platforms.The successful candidate will provide critical analytical support across various data-focused streams, primarily data modelling and migration. The position will...

  • Data Governance Specialist

    1 week ago

    Canberra, ACT, Australia beBeeGovernance Full time $90,000 - $94,000

    Job Title: Data Governance SpecialistThe role of the Data Governance Specialist is pivotal in ensuring the efficient management of data assets within our organization.Main Responsibilities:Implement data governance frameworks to align with industry standards and best practices.Design and implement changes to data management systems to support new business...