Data Engineer

3 weeks ago

Sydney, Australia Nine Full time
Job Description

Data Engineering builds and manages the pipelines, applications and infrastructure for collecting, processing, and storing Nine’s data. We are responsible for collecting hundreds of millions of events from client devices each day and streaming them directly into our data warehouse. We extract data from the majority of Nine’s enterprise systems, centralise it in our data warehouse, and create rich data models for analysis and to inform business operations and strategy.

The team is also responsible for building solutions to surface data to users including dashboards, Slack integrations and automated static reports, as well as providing data feeds to downstream systems for personalising audience experiences and commercialisation.

Role responsibilities

  • Design, develop and maintain data pipelines that extract, load and transform data from various sources into the data warehouses.

  • Design and implement data models that align with business requirements and support efficient querying and analysis.

  • Create dashboards, reports and visualisations that directly address business problems and inform and drive action.

  • Ensure the pipelines are reliable, scalable, and efficient, considering factors including data volume, velocity, and variety.

  • Implement data quality checks and validation processes to maintain accurate and reliable data.

  • Set up monitoring and alerting to proactively identify and resolve issues.

  • Perform root cause analysis for incidents and implement corrective actions.

  • Contribute to the technical design and vision for the data platform.

  • Collaborate with cross-functional teams, including product managers, data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.

  • Communicate technical concepts and solutions effectively to non-technical stakeholders.

  • Stay updated with emerging data engineering technologies and trends, and evaluate their potential benefits for the organisation's data ecosystem.


Qualifications

  • Fluent in at least one programming language (e.g. Python, C#, Java).

  • Proficient in SQL

  • Understanding of OLTP concepts including normalised schema design.

  • Understanding of OLAP concepts and data model design.

  • Experience in designing and building data pipelines, ETL processes, and managing data infrastructure.

  • Experience with automating workflows, and managing task dependencies using a tool like Apache Airflow.

Desirable:

  • A bachelor's or master's degree in computer science, software engineering, data engineering, data science, information technology or a related field.

  • Experience with Google Cloud Platform, AWS or Azure including services for data storage, processing, and analytics.

  • Experience with cloud deployment and test automation using a CI/CD solution such as Cloud Build or Concourse

  • Experience in deploying cloud infrastructure as code (IaC) using Terraform or similar



Additional Information

Our Commitment to Diversity and Inclusion:

At Nine, we are committed to fostering a workforce that embraces all aspects of diversity and inclusion and where practices are equitable to ensure our people experience a sense of belonging. From day one, you'll be encouraged to bring your whole self to work and will be supported to perform at your best. Should you require any adjustments to the recruitment process in order to equitably participate, we encourage you to advise us at the time of application.

We encourage applications from Aboriginal and Torres Strait Islander people, people with disabilities, and of all ages, nationalities, backgrounds and cultures.

Disclaimer: We do not accept unsolicited agency resumes and are not responsible for any fees related to unsolicited resumes.

  • Senior Azure Data Engineer

    4 weeks ago

    North Sydney, Australia NTT DATA Full time

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...

  • Data Engineer

    7 days ago

    Sydney, Australia TMGM Full time

    Join our team of talented data engineers and take on the exciting challenge of designing, constructing, installing, testing, and maintaining highly scalable data management systems. Not only will you ensure our systems meet business requirements and adhere to industry practices, but you will also have the opportunity to integrate cutting-edge data management...

  • Data Engineer

    4 weeks ago

    Sydney, Australia PayTech Nexus Ltd Full time

    Term: 12 monthsExperience Requirement: 3-5 yearsJob location: Sydney, AustraliaProject scope: Data Engineering in Credit Risk EnvironmentBackgroundWe are working with one of the major card schemes and a Tier 1 Australian Bank, based in Sydney. This role is a 12-month contract (likely extending to 2 years) and is for an experienced Data Engineer / Analyst...

  • Data Engineer

    4 weeks ago

    Sydney, Australia Practiv Full time

    As a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...

  • Data Engineer

    1 week ago

    Sydney, Australia Virtusa Full time

    Data Engineer - CREQ186610 Description Role Name: Data Engineer Must have 5+ years of experience in below mentioned skills. Must Have: Big Data Concepts , Python, SQL, Shell Scripting, AWS S3 Good to Have: Event-driven/AWA SQS, Microservices, API Development, Kafka, Kubernetes, Argo, Amazon Redshift, Amazon Aurora Primary Location Sydney, New South Wales,...

  • Data Engineer

    6 days ago

    Sydney, Australia Tech Mahindra Full time

    Data Engineer Skill Set: AWS Data Engineer-1 Total Experience: 5.00 to 8.00 Years No of Openings: 1 Job Post Date: 08/05/2024 Job Expiry Date: 30/06/2024 Domain: IT Location: SYDNEY [Australia] Job Reference...

  • Data Engineer

    3 weeks ago

    Sydney, Australia Ofload Full time

    About Ofload and our mission:At Ofload, we're at the forefront of digital freight services, empowering businesses to build efficient, flexible, and sustainable supply chains. Our mission is to achieve zero waste in trucking by digitising the transport industry.Every day in Australia, around 30% of trucks travel empty and a further 50% are idle amounting to...

  • Data Engineer

    3 weeks ago

    Sydney, Australia Mane Consulting Full time

    Are you a customer-obsessed data engineer who can focus on the delivery and innovation of new services? Can you use your Snowflake experience and knowledge to advise, design, and implement cost-effective solutions to our customers, whilst maintaining an excellent delivery posture? Do you want to shape your world and change the way the world works? Do you...

  • Manager, Data Engineering

    6 days ago

    Sydney, Australia Map Talent Full time

    **Job title**: **Manager, Data Engineering** **Job type**: - Perm**Emp type**: - Full-time**Skills**: Manager **Salary type**: - Annual**Salary**: - AUD $170,000.00**Job published**: - 24/11/2023**Job ID**: - 34455**Data Engineering Manager - Sydney - $180,000 + Super** We have just partnered with a business in Sydney who work with the latest...

  • Data Engineer

    7 days ago

    Sydney, Australia Cognizant Full time

    Job Description What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment! This is creating many opportunities for people like YOU — people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, together with your colleagues from all around the world,...

  • Data Engineer

    1 week ago

    Sydney, Australia Hydrogen Group Full time

    The Client My client is a leading financial organisation who are continuing their journey with multiple projects where they are looking for Data Engineers. This client is working on multiple projects which would give you an exciting opportunity to cutting edge Technology tools. The Role This role offers a great chance to join a team of Engineering...

  • Data Engineer

    6 days ago

    Sydney, New South Wales, Australia Cognizant Full time

    Job Description What makes Cognizant a unique place to work? The combination of rapid growth and an international and innovative environment This is creating many opportunities for people like YOU - people with an entrepreneurial spirit who want to make a difference in this world. At Cognizant, together with your colleagues from all around the world, you...

  • Senior Data Engineer

    4 weeks ago

    Sydney, Australia Pyramid Global Technologies Full time

    About the job Senior Data Engineer Job Description: Sr. Data Engineer *Power BI,*Tableau,*SQL advanced,*Data warehousing concepts, and everything related to data

  • Data Engineering Manager

    6 days ago

    Sydney, Australia The Argyle Network Full time

    -The Argyle Network Sydney, Australia Posted 9 hours ago Permanent Competitive Salary + Bonus - Are you a Data Engineering Manager or Tech Lead with experience in end-to-end transformations? Join our client - an Aussie Technology Bank!**The Client**: Leading Aussie Bank dedicated to innovation and collaboration. - Having invested in the latest cutting edge...

  • Data Engineering Lead

    4 weeks ago

    Sydney, Australia Correlate Resources Full time

    Our client is a market leading business with a high profile and reputable brand within the Australian market. With a well-established analytics division focused on optimising both customer and operational initiatives they boast an energising, supportive and collaborative culture, and are looking for great people who want to be a part of their journey. With...

  • Data Engineer

    4 weeks ago

    Sydney, Australia Firesoft People Full time

    About the Job Great Culture. Amazing opportunities for learning, development and growth. Multi-Cloud Solutions Provider. Work with some of the best in the industry. Fully remote work option. ASAP start. **** THIS ROLE CAN BE BASED ANYWHERE IN AUSTRALIA OR NEW ZEALAND **** About the Company: An Australian leading...

  • Senior Data Engineer

    4 weeks ago

    Sydney, Australia Woolworths Group Limited Full time

    Senior Data Engineer Work in a progressive, industry leading environment An exciting and inclusive culture of growth and innovation Sydney based with Surry Hills office location with WFH flexibility About Cartology Cartology is the Woolworths Group's stand alone media business and the exclusive media partner to Woolworths Supermarkets....

  • Senior Data Engineer

    2 weeks ago

    Sydney, Australia Technology People Australia Full time

    We are seeking highly skilled and motivated Data Engineers to join our client who are in financial domain. As a Data Engineer, you will play a critical role in designing, implementing, and maintaining their data infrastructure. Your expertise in Snowflake, Redshift, AWS, CloudFormation, Python, and SQL will be instrumental in shaping their data...

  • Senior Data Engineer

    4 weeks ago

    Sydney, Australia West Recruitment Full time

    - Not for profit- Excellent benefits- Flexible workingSenior Data Engineer required for our not for profit, Sydney based client.Key Responsibilities:This role will take responsibility for the following areas;•Leveraging Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage to build end-to-end...

  • Lead Data Engineer

    4 weeks ago

    Sydney, Australia West Recruitment Full time

    Join this certified 'Great Place to Work' businessSpearhead a Data Transformation initiativeWestern Sydney Location - Defined WFH PolicyAbout Your New EmployerWest Technology is proud to be partnering with an Australian owned group that has grown to become genuine market leader across multiple industry verticals.This business attributes its’ success to...