Data Engineer

7 hours ago

Macquarie Park, Australia Singtel Group Full time
About the Role

We are seeking a highly skilled Data Engineer to join our team at Optus. As a Data Engineer, you will be responsible for designing, building, and maintaining both batch and real-time data pipelines across on-premises and cloud platforms.

Key Responsibilities
  • Design and develop data pipelines to integrate data from diverse source systems and transform it into valuable assets for end-users and downstream applications.
  • Collaborate with cross-functional teams to ensure data is efficiently stored and seamlessly integrated into our data models, adhering to strict Data Governance and Architecture principles.
  • Develop data transformation jobs using Python and SQL on cloud platforms and ensure data completeness and accuracy.
  • Work closely with Data Science and Analytics teams to share insights, provide recommendations, and identify opportunities for advanced data model development to enhance business outcomes.
Requirements
  • 4+ years of experience in designing and building data pipelines, with expertise in both batch and real-time processing.
  • Strong proficiency in Databricks, Azure cloud data platforms or equivalent (e.g., AWS, Google Cloud).
  • Desirable hands-on experience with Databricks and big data technologies such as Hadoop, Spark, or Kafka for large-scale data processing.
  • Advanced skills in programming languages such as Python, SQL, or Scala for data manipulation and automation.
  • Experience with ETL tools and frameworks (e.g., Apache Airflow, DBT) for data transformation and integration.
  • Deep understanding of data modelling techniques and best practices for both structured and unstructured data.
  • Familiarity with Data Governance, ensuring high standards for data quality, consistency, and security.
  • Hands-on experience with big data technologies like Hadoop, Spark, or Kafka to handle large-scale datasets.
  • Strong problem-solving skills with the ability to troubleshoot data pipeline issues and optimise performance.
  • Excellent communication skills with the ability to collaborate effectively with cross-functional teams and translate technical concepts for non-technical stakeholders.
  • Bachelor's degree in computer science, engineering, or a related field, or equivalent industry experience.
What We Offer
  • 3 days in the office, 2 days remote – with flexible hours to suit.
  • Inclusive paid parental leave, up to 14 weeks for the primary care giver.
  • All Optus employees have access to resources, webinars and support via the 'Parents at Work portal'.
  • Own your own growth by accessing an extensive online and facilitator led learning catalogue – even earn a MBA micro-credential via OptusU (University).
  • Connect at work through one of our employee-led volunteer groups: Culture Connect, Elevate Women, Disability Network, Express Yourself (LGBTQIA+), United Veterans and Yarn Network.
  • Vibrant campus life, variety of facilities including restaurants, cafes, gymnasium, GP, and post office.
  • Two easy travel options to Sydney Campus: Optus bus from Sydney CBD (20min travel time) and Macquarie University Metro Station (every 6-8 minutes); morning and afternoon.

We are an equal opportunities employer and welcome applications from diverse candidates. If you require any adjustments or accessibility support to participate fairly and equitably in the recruitment process, please email along with your preferred method of contact and we will be in touch.

For more information on Diversity, Inclusion & Belonging at Optus, please visit

  • Senior Data Engineer, Data Lake Specialist

    3 weeks ago

    lake macquarie, Australia The Score Full time

    The Score, a leading digital media and sports betting company, is seeking a highly skilled Senior Data Engineer to join its Data Engineering team. As a key member of this team, you will play a critical role in developing and maintaining high-quality data-driven solutions to support the company's growth and profitability.About the RoleCollaborate with Data...

  • Construction Project Manager

    3 weeks ago

    Marsden Park, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Our company is headquartered in Canberra and has multiple facilities in the ACT, NSW, and New Zealand. We provide secure data centre configurations that support co-location, containerised, and hyperscale compute environments with all campuses...

  • Construction Project Manager

    2 weeks ago

    Marsden Park, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Our company is headquartered in Canberra and has multiple facilities in the ACT, NSW, and New Zealand. We provide secure data centre configurations that support co-location, containerised, and hyperscale compute environments with all campuses...

  • Senior Data Engineer

    5 days ago

    Oran Park, New South Wales, Australia Camden Council Full time

    Senior Data EngineerCamden Council is seeking a highly skilled Senior Data Engineer to lead the transformation of its data landscape using the latest Azure cloud services.This is an exciting opportunity for a seasoned data professional to make a significant impact in a forward-thinking environment while supporting Camden Council's strategic data...

  • Senior Data Engineer, Data Lake

    2 weeks ago

    Lake Macquarie City Council, Australia The Score Full time

    About the RoleTheScore, a leading sports media and betting company, is seeking a highly skilled Data Engineer to join its Data Engineering team. As a key member of this team, you will play a critical role in designing and maintaining the company's data infrastructure, ensuring the accuracy and reliability of data-driven insights.Key...

  • Test Engineer

    1 month ago

    Macquarie Park, Australia Singtel Full time

    Test Engineer It starts with YES! At Optus, we are fuelled by optimism, unwavering customer focus, and a team of amazing people. And that’s where we come in…. “the amazing people” part! We don’t sit back and wait for the future to happen, we are out there crafting our own path through new technology, innovation, and investment. We are...

  • Senior Data Engineer

    2 months ago

    Everton Park, Australia Woolworths Full time

    Senior Data Engineer Brisbane or Sydney office locations, with WFH flexibility Permanent role Work on a range of high impact data projects in the Woolworths People team Welcome to the People Team Better experiences for our Team Members are the key to unlocking a better future for our customers and communities. Our People Team is responsible for...

  • Data Centre Facilities Technician

    2 days ago

    Macquarie Park, Australia Macquarie Technology Group Full time

    About UsMacquarie Technology Group is a leading provider of data centre services, trusted by major international hyperscalers, large multinationals, and over 42% of Australian Federal Government Agencies. Our team is dedicated to delivering world-class customer care to corporate and government customers.The OpportunityWe are seeking a highly skilled and...

  • Machine Learning Engineer

    7 days ago

    Macquarie Park, Australia Singtel Full time

    Unlock the Power of AI and Machine LearningAt Optus, we're on a mission to revolutionize the way we live and work through cutting-edge technology and innovation. As a Specialist Machine Learning Engineer, you'll be at the forefront of this journey, leading the development of AI and ML solutions that shape the future.Your Key ResponsibilitiesDesign and...

  • Data Centre Facilities Technician

    24 hours ago

    Macquarie Park, Australia Macquarie Technology Group Full time

    About UsMacquarie Technology Group is a leading provider of data centre services, trusted by major international hyperscalers, large multinationals, and over 42% of Australian Federal Government Agencies. Our team is dedicated to delivering world-class customer care to corporate and government customers.The OpportunityWe are seeking a highly skilled Data...

  • Lead Data Analyst Apac

    3 months ago

    Macquarie Park, Australia Brambles Group Full time

    CHEP helps move more goods to more people, in more places than any other organization on earth via our 300 million pallets, crates and containers. We employ 11,000 people and operate in more than 55 countries. Through our pioneering and sustainable share-and-reuse business model, the world’s biggest brands trust us to help them transport their goods more...

  • Data Centre Solutions Strategist

    2 weeks ago

    Macquarie Park, Australia Schneider Electric Full time

    About the RoleWe are seeking a highly skilled and experienced professional to join our Secure Power/APC team as an Account Director in our Sydney office. As a key member of our team, you will be responsible for leading and managing the data centre solutions strategy with the Cloud and Service Provider segment.Key ResponsibilitiesDevelop and execute account...

  • Senior Data Engineer, Data Lake Specialist

    2 weeks ago

    Lake Macquarie City Council, Australia The Score Full time

    About The ScoreThe Score is a leading digital media and sports betting company that empowers millions of sports fans through its innovative products and services.Our MissionWe are committed to delivering high-quality and personalized experiences to our users, and we are seeking a talented Senior Data Engineer to join our Data Engineering team.About the...

  • Data Transformation Lead

    2 weeks ago

    Macquarie Park, Australia Singtel Full time

    Job Title: Data Transformation LeadWe're a dynamic team at Optus, always pushing the boundaries of innovation and technology. As a Data Transformation Lead, you'll play a crucial role in driving our data modernisation programs forward.Key Responsibilities:Lead and define program requirements, ensuring customer expectations are met and business interests are...

  • Senior Data Engineer, Data Lake Specialist

    2 weeks ago

    Lake Macquarie City Council, Australia The Score Full time

    About The ScoreThe Score is a leading digital media and sports betting company that empowers millions of sports fans through its innovative products and services.About the RoleWe are seeking a highly skilled Senior Data Engineer to join our Data Engineering team. As a key member of our team, you will be responsible for designing, developing, and maintaining...

  • Machine Learning Engineer

    2 weeks ago

    Macquarie Park, Australia Singtel Full time

    Unlock the Power of AI and Machine LearningAt Optus, we're on a mission to revolutionize the way we live and work through cutting-edge technology and innovation. As a Specialist Machine Learning Engineer, you'll be at the forefront of this journey, leading the development of AI and ML solutions that shape the future.Your Key ResponsibilitiesDesign and...

  • Machine Learning Engineer

    3 weeks ago

    Macquarie Park, Australia Singtel Full time

    Unlock the Power of AI and Machine LearningAt Singtel, we're pushing the boundaries of innovation and technology. As a Specialist Machine Learning Engineer, you'll be at the forefront of this revolution, leading cutting-edge projects that shape the future.Your Day in the LifeDevelop and analyze data to drive business decisions, ensuring alignment with...

  • Machine Learning Engineer

    6 days ago

    Macquarie Park, Australia Singtel Full time

    Unlock the Power of AI and MLAt Optus, we're pushing the boundaries of innovation and technology. As a Specialist Machine Learning Engineer, you'll be at the forefront of this revolution, leading cutting-edge projects that shape the future.Your Key ResponsibilitiesPrepare and analyze data to align with data science and machine learning objectives, ensuring...

  • Data Centre Facilities Technician

    5 days ago

    Macquarie Park, Australia Macquarie Technology Group Full time

    About UsMacquarie Technology Group is a leading provider of data centre services, trusted by major international hyperscalers, large multinationals, and over 42% of Australian Federal Government Agencies. Our team is dedicated to delivering world-class customer care to corporate and government customers.The OpportunityWe are seeking a highly skilled and...

  • Data Centre Facilities Technician

    4 days ago

    Macquarie Park, Australia Macquarie Technology Group Full time

    About UsMacquarie Technology Group is a leading provider of data centre services, trusted by major international hyperscalers, large multinationals, and over 42% of Australian Federal Government Agencies. Our team is dedicated to delivering world-class customer care to corporate and government customers.The OpportunityWe are seeking a highly skilled Data...