Data Engineering Manager

1 month ago


Melbourne, Victoria, Australia SkyBeam Technology Full time

SkyBeam Technology, a professional services company based in Australia, provides tailored workforce solutions to help businesses thrive in the evolving world. Our specialized workforce solutions include Recruitment Services, Contract Management, Outsourced Payroll Solutions, and HR Consulting.

The Role

You will be responsible for developing new data features primarily on our PySpark platform.

  • Drive best practices in data engineering and site reliability.
  • Guide the development team in delivering quality work, unit test coverage, and assist in creating development artifacts.

Ideal Profile

We are seeking an experienced professional with:

  • A minimum of 10 years of experience in a related field.
  • Expertise in building data pipelines using Python, PySpark, and SQL.
  • Proven experience in cloud environments like AWS or Azure.
  • Hands-on experience with ETL orchestration frameworks such as Apache Airflow or similar tools.
  • Experience with CI/CD systems such as ArgoCD, Jenkins, or Bamboo.
  • Bonus points if you have exposure to Financial Markets.

What We Offer

  • A Great Work Culture


  • Melbourne, Victoria, Australia NTT DATA Full time

    About the RoleNTT DATA is a global leader in business and technology services, with a commitment to innovation, optimization, and transformation. As a seasoned Business Intelligence Engineer, you will play a key role in delivering modern data solutions that drive business value.Job SummaryThis is a hybrid working opportunity where you will work closely with...


  • Melbourne, Victoria, Australia NTT DATA Full time

    About NTT DATAWe are a global leader in providing cutting-edge analytical solutions to our clients. Our focus on innovation has led us to form strategic partnerships with leading technology providers, including Microsoft Azure.Job DescriptionWe are seeking an experienced Senior Data Engineer to join our team. The successful candidate will have expertise in...


  • Melbourne, Victoria, Australia NTT DATA Full time

    Make an impact at NTT DATAWe are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society.Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.About the Role:The Business Intelligence engineer is a seasoned subject matter expert, tasked with...


  • Melbourne, Victoria, Australia Vantage Data Centers Full time

    About Vantage Data CentersVantage Data Centers is a leading provider of data center solutions, committed to delivering exceptional service and reliability. We are dedicated to creating a workplace that values diversity, equity, and inclusion, where everyone feels respected and empowered.Our mission is to power the world's most innovative companies by...


  • Melbourne, Victoria, Australia CDC Data Centres Full time

    About CDC Data Centres:We are a leading operator of sovereign, secure, world-class data centre facilities in Australia.Our diversified operations provide secure data centre configurations that support co-location, containerised and hyperscale compute environments with all campuses interconnected with high-speed carrier grade networks.We value diversity and...


  • Melbourne, Victoria, Australia CDC Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure data centre facilities in Australia.Headquartered in Canberra with multiple facilities across the ACT, NSW, VIC and New Zealand, we provide world-class data centre configurations that support co-location, containerised and hyperscale compute environments.We strive to create an inclusive...


  • Melbourne, Victoria, Australia NTT DATA Full time

    About NTT DATANTT DATA is a global leader in digital transformation, leveraging its extensive expertise to help enterprises harness the power of innovation and change.We are committed to driving business outcomes through our innovative services and solutions. Our focus on client satisfaction and commitment to community involvement set us apart as a trusted...


  • Melbourne, Victoria, Australia Vantage Data Centers Full time

    About Vantage Data Centers:Vantage Data Centers is a leading provider of data center solutions, committed to delivering high-quality facilities that meet the evolving needs of hyperscalers, cloud providers, and large enterprises.We operate in North America, EMEA, and Asia Pacific, with a focus on innovation, efficiency, and sustainability. Our team of...


  • Melbourne, Victoria, Australia Cdc Data Centres Full time

    **About Us:**Established in 2007, Cdc Data Centres is a leading operator of sovereign data centre facilities in Australia. Headquartered in Canberra with multiple facilities in the ACT, NSW and New Zealand, our diversified operations provide secure configurations that support co-location, containerised and hyperscale compute environments.We value diversity...


  • Melbourne, Victoria, Australia Dimension data Full time

    About the RoleAs a Senior Data Strategist for Business Growth, you will play a pivotal role in transforming data into actionable insights that drive business value at Dimension Data.About YouYou will be a seasoned subject matter expert with 3+ years of experience in data engineering and business intelligence. Your proficiency in tools like Azure Data...

  • Design Manager

    4 weeks ago


    Melbourne, Victoria, Australia CDC Data Centres Full time

    About CDC Data Centres:We are a leading operator of sovereign, secure, world-class data centre facilities in Australia. Established in 2007, we have multiple facilities in the ACT, NSW, VIC and New Zealand.At CDC Data Centres, we value diversity and create an inclusive workplace that promotes it. Our mission is to attract, retain and grow the world's best...


  • Melbourne, Victoria, Australia NTT DATA Full time

    About NTT DATANTT DATA is a leading global innovator of business and technology services, serving 75% of the Fortune Global 100 companies. We're committed to helping clients innovate, optimize, and transform for long-term success.Job OverviewWe're seeking an experienced Senior Data Analytics Strategist to join our team in Sydney, Australia. As a seasoned...


  • Melbourne, Victoria, Australia NTT DATA Full time

    About the RoleWe are seeking a seasoned Data & Analytics Consultant to join our team at NTT DATA. As a key member of our organization, you will be responsible for leveraging your technical expertise to drive business value through data analytics, visualization, and modeling.Key ResponsibilitiesWork collaboratively with cross-functional teams to deliver...


  • Melbourne, Victoria, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading provider of sovereign, secure data centre facilities in Australia.Established in 2007, we offer world-class data centre configurations that support co-location, containerised and hyperscale compute environments.We are passionate about creating an inclusive workplace that promotes diversity and values individual...


  • Melbourne, Victoria, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.We are headquartered in Canberra with multiple facilities in the ACT, NSW, and New Zealand. Our diversified operations provide secure data centre configurations that support co-location, containerised, and hyperscale compute environments with...


  • Melbourne, Victoria, Australia Cdc Data Centres Full time

    About UsCDC Data Centres is a leading operator of sovereign, secure, world-class data centre facilities in Australia.Established in 2007, we provide diverse operations with secure data centre configurations that support co-location, containerised and hyperscale compute environments.We are committed to fostering a diverse and inclusive workplace where all...


  • Melbourne, Victoria, Australia CDC Data Centres Full time

    About CDC Data Centres:We are a leading operator of sovereign, secure, world-class data centre facilities in Australia and New Zealand.Our mission is to attract, retain and grow the world's best data centre team by promoting an inclusive workplace that values diversity and employee growth.We configure the landscape to meet the security, reliability,...


  • Melbourne, Victoria, Australia CDC Data Centres Full time

    About CDC Data Centres:We are a leading operator of sovereign, secure, world-class data centre facilities in Australia, with a diversified operations providing secure data centre configurations that support co-location, containerised and hyperscale compute environments.We are passionate about creating an inclusive workplace that promotes and values...


  • Melbourne, Victoria, Australia CDC Data Centres Full time

    About UsCDC Data Centres is Australia's leading operator of sovereign, secure, world-class data centre facilities. Established in 2007, we provide secure data centre configurations that support co-location, containerised and hyperscale compute environments with all campuses interconnected with high-speed carrier grade networks.Job DescriptionWe are seeking a...


  • Melbourne, Victoria, Australia CDC Data Centres Full time

    Seeking a senior design professional to lead the development of data centre designs at CDC Data Centres.About UsCDC Data Centres is Australia's leading operator of sovereign, secure, world-class data centre facilities. Established in 2007, we provide secure data centre configurations that support co-location, containerised and hyperscale compute environments...