Current jobs related to Senior Data Engineer, Data Lake Specialist - Lake Macquarie City Council - The Score


  • Lake Macquarie City Council, Australia The Score Full time

    About the RoleTheScore, a leading sports media and betting company, is seeking a highly skilled Data Engineer to join its Data Engineering team. As a key member of this team, you will play a critical role in designing and maintaining the company's data infrastructure, ensuring the accuracy and reliability of data-driven insights.Key...


  • North Sydney Council, Australia NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Azure Data Engineer to join our team at NTT DATA Business Solutions. As a key member of our Analytics Practice, you will be responsible for designing and developing cloud-based data solutions using Microsoft Azure technologies.Key ResponsibilitiesAnalyze current business practices and identify...


  • North Sydney Council, Australia NTT DATA Full time

    Job Title: Senior Azure Data EngineerNTT DATA is a global leader in providing innovative solutions to its clients. Our team is focused on delivering cutting-edge analytical solutions using the latest technologies, including Microsoft Azure.Job Summary:We are seeking a highly skilled Senior Azure Data Engineer to join our team. The successful candidate will...


  • North Sydney Council, Australia NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Azure Data Engineer to join our team at NTT DATA. As a key member of our analytics practice, you will be responsible for designing and developing cloud-based data platforms and associated technologies.Key ResponsibilitiesAnalyze current business practices and identify opportunities for leveraging Microsoft...


  • North Sydney Council, Australia NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Azure Data Engineer to join our team at NTT DATA. As a key member of our analytics practice, you will be responsible for designing and developing cloud-based data platforms and associated technologies.Key ResponsibilitiesCloud Data Platform Development: Design and develop cloud-based data platforms using...

  • Data Engineer

    21 hours ago


    Macquarie Park, Australia DXC Technology Full time

    Job Description:DXC Technology (NYSE: DXC) helps global companies run their mission-critical systems and operations while modernizing IT, optimizing data architectures, and ensuring security and scalability across public, private and hybrid clouds. The world's largest companies and public sector organizations trust DXC to deploy services to drive new levels...

  • Data Engineer

    2 weeks ago


    Macquarie Park, Australia Catholic Healthcare Full time

    Data Engineer 15 Talavera Rd, Macquarie Park NSW 2113, Australia Req #485 Saturday, 26 October 2024Discover a career where care goes both ways! Based at Macquarie Park, close to Metro Station, WFH Options  Permanent Opportunity to join a large internal IT team at a time of growth  7...


  • Macquarie Park, Australia Catholic Healthcare Full time

    About the RoleCatholic Healthcare is seeking a highly skilled Data Engineer to join our internal Development Team and the broader IT team. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines, enabling Catholic Healthcare to leverage data for decision-making and analytics.Key ResponsibilitiesMonitor and...

  • Data Engineers

    2 weeks ago


    Darwin City, Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia only respond. must hold a valid Baseline security clearance or be willing and eligible to obtain one. Essential criteria: 1. Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment. 50% 2. Experience...


  • North Sydney Council, Australia Data#3 Ltd Full time

    About the RoleWe are seeking an experienced Data Centre Practice Leader to join our team at Data#3 Ltd. As a key member of our leadership team, you will be responsible for driving Data Centre sales and leading the development of our Data Centre value proposition.Key ResponsibilitiesLead the development and promotion of Data#3's Data Centre value proposition...


  • North Sydney Council, Australia Data#3 Ltd Full time

    As a Data Centre Practice Leader at Data#3 Ltd, you will drive the company's Data Centre partnerships and lead sales to power our customers' critical workloads. You will guide our practice, align it with company goals, and strengthen key relationships with customers and vendors.This role requires a depth of Data Centre expertise and the passion to drive...


  • North Sydney Council, Australia Data#3 Ltd Full time

    {"title": "Data Centre Practice Leader", "description": "Job SummaryAs a Data Centre Practice Leader at Data#3 Ltd, you will drive the company's Data Centre partnerships and lead sales to power our customers' critical workloads. You will guide our practice, align it with company goals, and strengthen key relationships with customers and vendors.Key...


  • Macquarie Park, Australia Singtel Group Full time

    Senior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Optus. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining data pipelines across on-premises and cloud platforms.Your Key ResponsibilitiesDesign, build, and optimise data architecture and ETL pipelines to enable...


  • Macquarie Park, Australia Aegros Therapeutics Pty Ltd Full time

    **Who we are** Aegros is Latin for ‘Patient’. We chose this name because it speaks to our focus on the patient. Every day we strive to place the patient first by providing therapeutic plasma products they would not otherwise be able to access. At Aegros we believe access to life saving therapeutic plasma drugs is a human right and not a privilege. In a...


  • Macquarie Park, Australia Singtel Full time

    Unlocking Business Potential with AIAt Singtel, we're committed to harnessing the power of AI to drive innovation and growth. Our vision is to become a leader in the digital transformation of businesses, and we're seeking a talented Senior Digital Data Analyst to join our team.This role is for a data specialist who can extract insights from complex data sets...


  • North Sydney Council, Australia Equifax Full time

    Job Title: Senior Data Governance SpecialistAt Equifax, we're seeking a highly skilled Senior Data Governance Specialist to join our team. As a key member of our data governance team, you'll play a critical role in ensuring the accuracy, completeness, and consistency of our data assets.Key Responsibilities:Design and implement metadata solutions to ensure...


  • North Sydney Council, Australia Equifax Full time

    Job Title: Senior Data Governance SpecialistAt Equifax, we're seeking a highly skilled Senior Data Governance Specialist to join our team. As a key member of our data governance team, you will play a critical role in ensuring the accuracy, completeness, and security of our data assets.Key Responsibilities:Design and implement metadata solutions to ensure...

  • Data Engineer

    1 month ago


    Macquarie Park, Australia Singtel Group Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Optus. As a Data Engineer, you will be responsible for designing, building, and maintaining both batch and real-time data pipelines across on-premises and cloud platforms.Key ResponsibilitiesDesign and develop data pipelines to integrate data from diverse source systems and...


  • Willoughby City Council, Australia Charterhouse Recruitment Full time

    Job Title: Data Centre Platforms and Security Senior EngineerWe are seeking a highly skilled Data Centre Platforms and Security Senior Engineer to join our team at Charterhouse Recruitment.About the RoleThe main objective of this role is to plan, develop, and deliver system architecture that aligns with State-wide Network Services automation roadmaps. This...


  • Willoughby City Council, Australia Charterhouse Recruitment Full time

    Job Title: Data Centre Platforms and Security Senior EngineerWe are seeking an experienced Data Centre Platforms and Security Senior Engineer to join our team at Charterhouse Recruitment.About the RoleThe main objective of this role is to plan, develop, and deliver system architecture that aligns with State-wide Network Services automation roadmaps. This...

Senior Data Engineer, Data Lake Specialist

2 months ago


Lake Macquarie City Council, Australia The Score Full time

About The Score

The Score is a leading digital media and sports betting company that empowers millions of sports fans through its innovative products and services.

About the Role

We are seeking a highly skilled Senior Data Engineer to join our Data Engineering team. As a key member of our team, you will be responsible for designing, developing, and maintaining our data pipelines and infrastructure to support our business initiatives.

Key Responsibilities

  • Collaborate with Data Science, Reporting, Analytics, and other engineering teams to build data pipelines, infrastructure, and tooling to support business initiatives
  • Oversee the design and maintenance of data pipelines and contribute to the continual enhancement of the data engineering architecture
  • Collaborate with the team to meet performance, scalability, and reliability goals
  • Write out tests and thorough documentation for processes and tooling
  • Adapt to working with new technologies and frameworks, sometimes leading the investigation into their usefulness to the team
  • Maintain and expand existing systems, tooling, and infrastructure
  • Maintain the data lake ensuring data integrity and performance
  • Take ownership of projects, plan, and collaborate with other members of the Analytics and Reporting teams or others within the company

Requirements

  • A solid foundation in computer science, with strong competencies in data structures, distributed systems, algorithms, and software design
  • 5+ years of experience in data or software engineering
  • Strong knowledge of Python
  • Strong knowledge of streaming technologies, like Kafka
  • Strong knowledge of Docker and Kubernetes
  • Strong knowledge of relational databases and SQL
  • Experience building out a scalable infrastructure to fit the needs of a growing company
  • Experience in data ingestion and processing, including Third-Party APIs (e.g. AppsFlyer, Branch, Facebook, etc.)
  • Experience with Red Shift, Big Query, or other SQL-based data warehouses
  • Experience with at least one major cloud platform (AWS, GCP, Azure)
  • Experience with testing frameworks such as RSpec, Jest, pytest, or equivalent
  • Strong organization and collaboration skills
  • Excellent written and oral communication skills

Nice to Have

  • Experience working with Data Scientists or deploying machine learning models
  • Experience developing frontend applications, using JavaScript and React

What We Offer

  • Competitive compensation package
  • Fun, relaxed work environment
  • Education and conference reimbursements
  • Parental leave top-up
  • Opportunities for career progression and mentoring others