Large Scale Data Pipeline Developer

1 month ago


Melbourne, Victoria, Australia Xero Full time
About the Job

Xero is seeking a talented Data Engineer to join our Marketing Data Science, Analytics & Insights team. The ideal candidate will have experience in designing and implementing large-scale data pipelines, integrating with various systems, and ensuring data quality and validation.

Key Responsibilities:
  • Design and implement data pipelines using Kafka, Customer Data platform, and OLAP systems
  • Develop and deploy data pipelines following DevOps principles and incorporating automated code and data testing
  • Collaborate with cross-functional teams to identify areas for improvement and implement changes
  • Provide technical leadership and guidance to junior team members
  • Stay up-to-date with industry trends and emerging technologies, and recommend new approaches and tools
Requirements:
  • 5+ years of experience in data engineering, with a strong background in software development and data architecture
  • Experience with big data processing frameworks such as Hadoop, Spark, or Flink
  • Proficiency in programming languages such as Java, Python, or Scala
  • Strong understanding of database concepts, including NoSQL databases such as Cassandra, MongoDB, or Redis
  • Excellent problem-solving skills, with the ability to troubleshoot complex issues
  • Ability to communicate complex technical concepts to non-technical stakeholders
Why Work at Xero?

Xero is a leading cloud-based accounting software company, and we're proud to offer a unique and exciting opportunity for talented individuals to join our team.

Our company culture is built around innovation, collaboration, and customer obsession. We're committed to making a positive impact on our customers' lives and businesses.



  • Melbourne, Victoria, Australia Easygo Full time

    We are seeking a highly skilled Senior Full Stack Developer to join our team at Easygo. As a Senior Full Stack Developer, you will be responsible for designing, developing, and deploying large-scale systems that operate at thousands per second frequency. You will work alongside a squad of Full-Stack Engineers in a cloud native tech stack including AWS,...


  • Melbourne, Victoria, Australia Xero Full time

    About the JobWe are seeking an experienced Data Engineer to join our team at Xero. As a Data Engineer, you will be responsible for designing and implementing large-scale data pipelines, integrating with various systems, and ensuring data quality and validation.Key Responsibilities:Design and implement data pipelines using Kafka, Customer Data platform, and...


  • Melbourne, Victoria, Australia Australia And New Zealand Banking Group Limited Full time

    About UsOur MissionWe are Australia And New Zealand Banking Group Limited, a leading financial institution dedicated to serving our customers and communities. We aim to improve the financial wellbeing and sustainability of millions of people.About the RoleWe are seeking a talented Machine Learning Engineer/Data Scientist to join our team. As a key member of...


  • Melbourne, Victoria, Australia Australia And New Zealand Banking Group Limited Full time

    About the RoleAs a Machine Learning Engineer/Data Scientist at Australia And New Zealand Banking Group Limited, you are accountable for building advanced models to understand and solve complex data problems through advanced modelling.Key Responsibilities:Determine the relevant internal and external data sources to enable developing predictive and descriptive...

  • Lead Data Architect

    3 weeks ago


    Melbourne, Victoria, Australia Demyst Full time

    Demyst is a leading data management company specializing in external data orchestration for global financial institutions. We are seeking an experienced Senior Software Engineer to join our team and help scale our solution.We offer a standard configurable interface connecting external data ecosystems to centralized data platforms, providing necessary...


  • Melbourne, Victoria, Australia Cognizant Full time

    Senior Data Engineering LeaderCognizant seeks a seasoned Enterprise Data Architect Lead to spearhead the design and implementation of cutting-edge data platforms, driving innovation and excellence in data engineering and cloud solutions.Role OverviewThis strategic role demands a visionary approach to solving complex business challenges through advanced...

  • SAP Project Director

    4 weeks ago


    Melbourne, Victoria, Australia HCLTech Full time

    HCLTech is a leading technology company that empowers progress through industry-leading capabilities centered around Digital, Engineering, and Cloud.We are seeking an experienced SAP Program Director to join our team in Melbourne, AU. As a key member of our team, you will oversee and manage projects related to the implementation, migration, and upgrade of...


  • Melbourne, Victoria, Australia Cognizant Full time

    Cognizant is a leading technology consulting firm that empowers businesses to modernize and thrive in today's fast-paced digital landscape. As a Senior Data Engineering Leader for Databricks Innovations, you will play a pivotal role in driving cutting-edge data engineering strategies and solutions that deliver measurable business outcomes.Key...


  • Melbourne, Victoria, Australia Agoda Full time

    About AgodaAgoda is a leading online travel booking platform that connects travelers with a global network of accommodations, flights, and more.We are a dynamic team of innovators who build and deploy cutting-edge technology to make travel easy and rewarding for everyone.As a Data Engineer at Agoda, you will play a critical role in shaping the future of our...


  • Melbourne, Victoria, Australia Jemena Full time

    The role of Senior Cathodic Protection Engineer – Pipelines at Jemena is a unique opportunity to work with one of the leading companies in Australia's energy sector. As a member of their team, you will be responsible for providing engineering and technical services to ensure the safety, reliability, integrity, and long-term value of Jemena's pipeline...


  • Melbourne, Victoria, Australia Go1 Full time

    Key Responsibilities:We are looking for a skilled professional to join our team as a Data Engineer. The ideal candidate will have experience in integrating streaming and batch data from source systems and be proficient in big data tools and batch processing technologies.Analyze, design, develop, and test data processing pipelines, warehouses, marts, models,...


  • Melbourne, Victoria, Australia Jemena Full time

    Join our team as a Senior Cathodic Protection Engineer – Pipelines at Jemena and contribute to the company's mission to provide safe, reliable, and efficient energy solutions. In this role, you will be responsible for providing engineering and technical services to support the safety, reliability, integrity, and long-term value of Jemena's pipeline...

  • Data Scientist

    7 days ago


    Melbourne, Victoria, Australia Canva Full time

    **About Canva**We're a leading software-as-a-service (SaaS) company that makes it easy for anyone to create visually appealing designs. Our product is used by millions of people worldwide, and we're growing rapidly.**The Print Group at Canva**The Print Group is a dynamic part of our organization focused on making print easier, smarter, and more enjoyable for...


  • Melbourne, Victoria, Australia AirTrunk Full time

    AirTrunk is a leading company in AU, continuously growing rapidly.As Senior Construction Project Manager - Data Centre Development, you will report to the Development Manager and work closely with the Development team.The role involves project managing and leading all aspects of construction-related activities for new builds and fit-out projects, including...

  • Data Engineer

    1 month ago


    Melbourne, Victoria, Australia Xero Full time

    About the JobXero is seeking a highly skilled Data Engineer to join our Marketing Data Science, Analytics & Insights team. The successful candidate will be responsible for engineering large and complex data sets, building robust, reusable, and optimized data pipelines, and supporting the implementation of data transformation for analytics, business...


  • Melbourne, Victoria, Australia Culture Amp Full time

    About Culture AmpCulture Amp is a pioneering company in Australia, committed to fostering a work environment that truly cares for and develops its people. We believe that our employees are the heartbeat of our success.Job OverviewThis role presents a unique opportunity to join our rapidly growing team as a Data Engineer - Data Intelligence - Team Better...


  • Melbourne, Victoria, Australia Cognizant Full time

    Cognizant is seeking a highly skilled Cloud Data Engineering Lead to join our Data & AI practice.This senior role demands a visionary approach to solving complex business challenges through cutting-edge data engineering and cloud solutions.The ideal candidate will have 7-10 years of progressive experience in data engineering, with deep expertise in the...

  • Senior Data Engineer

    3 weeks ago


    Melbourne, Victoria, Australia Xero Full time

    About the RoleThis is an exciting opportunity to join Xero's Marketing Data Science Analytics Insights team as a Senior Data Engineer - Team Lead. In this role, you will lead data engineers and build robust, reusable, and optimized data pipelines.Key AccountabilitiesLead data engineers to design and implement data pipelines.Work closely with stakeholders to...


  • Melbourne, Victoria, Australia Australia And New Zealand Banking Group Limited Full time

    About UsAt ANZ, our purpose is to shape a world where people and communities thrive. We believe in harnessing the power of technology to deliver exceptional customer experiences.Division OverviewThe Technology Division at ANZ is responsible for designing, developing, and deploying innovative digital banking services. Our goal is to empower customers with...


  • Melbourne, Victoria, Australia Anduril Industries Full time

    We are seeking a highly experienced Senior Machine Learning/MLOps Engineer to join our team at Anduril Industries in Australia.As a leader in defence technology, we leverage Silicon Valley talent and funding to develop innovative solutions to real-world challenges. Our team of experts in AI, computer vision, sensor fusion, optics, and data analysis creates...