Platform Data Engineer
1 week ago
Overview
Within Commodities and Global Markets, our Data Platform team is responsible for building and maintaining the data warehouse and re-usable ETL pipelines for engineering teams. You will work on building solutions for big data using the newest technologies available. At Macquarie, our advantage is bringing together diverse people and empowering them to shape all kinds of possibilities. We are a global financial services group operating in 31 markets and with 56 years of unbroken profitability. You’ll be part of a friendly and supportive team where everyone - no matter what role - contributes ideas and drives outcomes.
What role will you play?
As a Platform Data Engineer, you will be responsible for building new features on our data platform primarily in Python. These could include re-usable data quality rules and data observability capabilities for reporting. You will also be responsible for making ease-of-use improvements to the platform for the engineering teams that use it, as well as security vulnerability and credential management on the platform. This role works closely with several different teams including the Group Data Office (GDO), data onboarding engineering teams, technical testing teams, business analysts and architects. You will be involved in all stages of the SDLC from solution design through to build, test and demo to the business. As part of the platform team, you will have an ownership mentality and constantly improve the platform for the teams which use it.
What you offer
- Strong knowledge of Python and SQL
- Experience using AWS or other cloud providers such as GCP or Azure
- Expert knowledge of release management/deployment for ETL pipelines (testing, linting, rollback)
- Good knowledge of Git (Bitbucket) and GitOps, particularly trunk workflow
- Experience setting up CI/CD systems such as ArgoCD, Jenkins, Bamboo
- Expert knowledge of big data/data warehouse management (Redshift)
- Experience in other coding languages such as Java and Go, as well as data governance/exploration tools such as Dataiku and Alation is highly valuable
- Cloud certifications (e.g. AWS certified data engineer) are beneficial
- Experience working in a regulated environment with a high focus on security and auditability for code is highly regarded
What we offer
- 1 wellbeing leave day per year
- Up to 5 additional service bonus leave days per year
- Up to 20 weeks’ paid parental leave for primary caregivers along with 12 days of transition leave upon return to work, and 6 weeks’ paid leave for non-primary caregivers
- 2 days of paid volunteer leave and donation matching
- Up to 12 months’ gender affirmation leave, including 6 weeks’ paid leave
- Access to Employee Assistance Program and wellbeing benefits including skin and health checks, and flu vaccinations
- Access to a wide range of salary packaging options
- Access to a wide range of learning and development opportunities, including reimbursement for professional membership or subscription
- Hybrid and flexible working arrangements, dependent on role
- Reimbursement for work from home equipment
About Technology
Technology enables every aspect of Macquarie, for our people, our customers and our communities. We’re a global team that is passionate about accelerating the digital enterprise, connecting people and data, building platforms and applications and designing tomorrow’s technology solutions.
Our commitment to diversity, equity and inclusion
We are committed to fostering a diverse, equitable and inclusive workplace. We encourage people from all backgrounds to apply and welcome all identities, including race, ethnicity, cultural identity, nationality, gender (including gender identity or expression), age, sexual orientation, marital or partnership status, parental, caregiving or family status, family and domestic violence status, neurodiversity, religion or belief, disability, or socio-economic background. We welcome further discussions on how you can feel included and belong at Macquarie as you progress through our recruitment process. To learn more, contact our team by clicking here.
Our aim is to provide reasonable adjustments to individuals who may need support during the recruitment process and through working arrangements. If you require additional assistance, please let us know in the application process.
#J-18808-Ljbffr
-
Lead Data Engineer: Data Platform
8 hours ago
Council of the City of Sydney, Australia Macquarie Bank Limited Full timeA leading global financial services group is looking for a Lead Engineer to develop innovative data platform features. You will bring extensive experience in software and data engineering, particularly with Python. The ideal candidate has a strong leadership background, experience in AWS, Docker, and Kubernetes, and will engage with various stakeholders....
-
Senior Data Engineer — Lead Data Platform
8 hours ago
Council of the City of Sydney, Australia Singtel Group Full timeA leading telecommunications company in Australia is seeking a Staff Data Engineer to join their Data Engineering Centre of Excellence. This senior role combines hands-on engineering with strategic leadership to shape the future of their enterprise data platform. Candidates should possess strong experience with cloud data platforms and proficiency in Python...
-
Senior Data Platform Engineer
6 days ago
City of Melbourne, Australia Capgemini Full timeChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired bya collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizationsunlock the value of technology...
-
Data Platform Engineering Lead
8 hours ago
Council of the City of Sydney, Australia DroneShield Group Pty Ltd Full timeA leading technology firm in Sydney is seeking a Data Platform Engineering Team Lead to build and lead a team responsible for developing data capture tools and infrastructure. Candidates should have extensive experience with AI/ML systems and a strong technical background. This role involves driving solutions to successful outcomes in a fast-growing company...
-
Data Platform and Operations Lead
8 hours ago
Council of the City of Sydney, Australia Evolution Mining Full timeFrom humble beginnings in 2011, Evolution Mining is now a leading gold producer, operating six mines across Australia and Canada. Enacting our vision to be inspired people creating a premier global gold company, we are indeed a bold team with a bright future. Our operational diversity offers our employees access to many experiences and career opportunities...
-
Data Engineer
6 days ago
Council of the City of Sydney, Australia TRAILD PTY LTD Full timeAbout TRAILD TRAILD is a dynamic, fast-growing, remote-first SaaS company that streamlines, automates, and protects Accounts Payable (AP). Just as your bank provides always-on protection for your credit card, TRAILD delivers the same level of security to help businesses safeguard their B2B payments from fraud, errors, and mistakes. Our specialised...
-
Senior Data Engineer
8 hours ago
Council of the City of Sydney, Australia Neara Group Full timeImagine preventing wildfires before they start, or ensuring power grids stay resilient during extreme weather. That’s the real-world impact we create every day at Neara. We build 3D physics-enabled digital twins of critical infrastructure networks that help utilities and infrastructure companies run scenarios, assess risks, and make smarter decisions that...
-
Senior Data Engineer
3 weeks ago
Council of the City of Sydney, Australia black.ai Full timeLocation Melbourne HQ or Sydney Employment Type Full time Department Engineering Who is Heidi? Heidi is building an AI Care Partner that supports clinicians every step of the way, from documentation to delivery of care. We exist to double healthcare’s capacity while keeping care deeply human. In 18 months, Heidi has returned more than 18 million...
-
Senior Data Platform Engineer
2 weeks ago
Council of the City of Sydney, Australia HSO Enterprise Solutions GmbH Full timeAtHSO/Aware, we’re specialists in emerging tech—and we’re growing fast across the ANZ region. That means we’re on the lookout for aSenior Data Platform Engineerwho’s not just technically sharp, but also thrives in a consulting environment and loves solving real-world problems with cloud-native data solutions. Why Join Us? We’re a tight-knit,...
-
Principal Data Engineer
4 weeks ago
Council of the City of Sydney, Australia Deputy Full timeDeputy is a global SaaS remote‑first workforce management company with hubs in Sydney, Melbourne, San Francisco and London, plus team members working remotely across the United States. Our platform serves over 1.5 million workers and 375,000 workplaces across 100+ countries. We are backed by top global investors and recently achieved Unicorn status. At...