Data Engineer
4 weeks ago
Data Engineer
Permanent role Hybrid and flexible working environment Sydney (Norwest) office locationAbout Woolworths
Woolworths Group is a food and everyday needs retailer united by the shared purpose of creating better experiences together for a better tomorrow. With more than 1,400 stores across its Woolworths Supermarkets, Countdown Supermarkets (New Zealand) and BIG W brands, and fast-growing eCommerce businesses, Woolworths Group is Australia and New Zealand’s largest retailer. A top 10 company on the Australian Securities Exchange (ASX), Woolworths Group employs more than 180,000 team members and serves more than 20 million customers a week.
About the role
The Risk Analytics team helps the risk community across Woolworths Group use data to make risk-informed choices with confidence and helps them focus on what matters most. The team drives the organisation towards the effective use of data and analytics to support decision-making and early detection of issues across Woolworths Group
We are searching for a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP) to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and infrastructure on GCP to support our organisation's data-driven initiatives.
Responsibilities will include, but are not limited to:
Design and develop scalable, reliable, and efficient data pipelines using GCP technologies such as BigQuery, Cloud Dataflow, Cloud Storage, and Pub/Sub. Architect and implement data models, schemas, and structures that support optimal data storage, retrieval, and analysis. Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and implement solutions that meet business needs. Optimise data workflows and ensure data quality, integrity, and security throughout the entire data lifecycle. Perform data modelling, schema design, and performance tuning to support efficient data storage and retrieval. Implement data governance practices and ensure compliance with Group Data Management policies Monitor and troubleshoot data pipelines, proactively identifying and resolving issues to ensure system stability and performance. Ensure data quality and integrity by implementing robust data validation, cleansing, and governance processes. Stay up to date with the latest advancements in GCP technologies and provide recommendations for adopting new tools and frameworks to enhance data engineering capabilities. Develop and maintain documentation for data engineering processes, workflows, and solutions.Who we are looking for
We are looking for an experienced Data Engineer, with proven technical capabilities, alongside excellent problem-solving skills and the ability to analyse complex data-related issues.
This role will work on a variety of data engineering projects within the risk team and will collaborate closely with data science and analytics team members.
Requirements:
Proven experience in data engineering, with a focus on designing and implementing solutions on Google Cloud Platform. Strong proficiency in GCP services such as BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, and Data Catalog. Solid understanding of data modelling, ETL/ELT processes, and data integration techniques. Proficiency in programming languages such as Python, Java, or Scala, with experience in writing efficient and scalable code. Experience with version control systems Git) and CI/CD practices. Familiarity with data governance, data security, and compliance frameworks. Ideally a Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment. Grow with the Group
As an inclusive, team-first company
-
Senior Azure Data Engineer
4 days ago
Sydney, New South Wales, Australia NTT DATA Full timeJob Description NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network...
-
Senior Azure Data Engineer
2 months ago
North Sydney, Australia NTT DATA Full timeNTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...
-
Senior Azure Data Engineer
4 days ago
North Sydney Council, Australia NTT DATA Full timeNTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...
-
AWS Data Analyst
4 days ago
Sydney, New South Wales, Australia The Data Foundry Full timeJob DescriptionYour impact As an AWS Data Analyst, you will play a key role in working with customers to understand their business requirements, map these to their data capabilities, liaise with our internal Data Engineers to design and build elegant solutions, then partner with our customers to deploy those solutions in a way that allows them to turn data...
-
Data Analyst
1 week ago
Sydney, Australia The Data Foundry Full timeCompany Description We are a customer-obsessed, “one stop shop” for all things data-related. We are deliberately narrow in our focus areas but we go deep in each of them. We provide solutions, services and training in the **data strategy, data governance, data security, data management, data classification, data wrangling, data lake, data analytics,...
-
Data Analyst
2 months ago
Sydney, Australia The Data Foundry Full timeCompany Description We are a customer-obsessed, “one stop shop” for all things data-related. We are deliberately narrow in our focus areas but we go deep in each of them. We provide solutions, services and training in the **data strategy, data governance, data security, data management, data classification, data wrangling, data lake, data analytics,...
-
Data Analyst
2 months ago
Sydney, Australia The Data Foundry Full timeCompany Description We are a customer-obsessed, “one stop shop” for all things data-related. We are deliberately narrow in our focus areas but we go deep in each of them. We provide solutions, services and training in the **data strategy, data governance, data security, data management, data classification, data wrangling, data lake, data analytics,...
-
Azure Devops Engineer
4 days ago
Sydney, New South Wales, Australia Data#3 Full timeEngineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights Join Microsoft's largest Australian Partner HRD Employer of Choice and Great Place to Work Brisbane, Sydney or Melbourne Based - Hybrid Working As an Azure Dev Ops Engineer you will work across multiple organisations, managing the latest...
-
Data Specialist
2 months ago
Sydney, Australia Data Addiction Pty Ltd Full time**What you’ll need before applying**: - At least 2 years’ experience in building data solutions, preferably in Microsoft Azure. - Experience in delivering projects using Agile/Scrum methods. - Strong problem-solving skills and the ability to deliver value. - Strong verbal and written communication skills. - Tertiary qualifications in Computer Science,...
-
Ms Engineer
4 days ago
Sydney, New South Wales, Australia Ntt Data Full timeNTT DATA NTT DATA helps clients transform through consulting, industry solutions, business process services, IT modernization and managed services. View company page Want to be a part of our team?The Security Managed Services Engineer (L4) is responsible for ensuring a managed service is provided to all clients, to ensure that their Security infrastructure...
-
Data Engineer
4 days ago
Sydney, New South Wales, Australia HiTech Group Full timeLeading Federal Government Department Initial 12 month contract + 12 month extension Rewarding daily rates $$$ A dynamic Federal Government Department is looking to engage an experienced Data Engineer to be apart of the department's internal key data centric projects. You will be responsible demonstrating strong data engineering and analytics skills with...
-
Data Engineer
2 months ago
Sydney, Australia TMGM Full timeJoin our team of talented data engineers and take on the exciting challenge of designing, constructing, installing, testing, and maintaining highly scalable data management systems. Not only will you ensure our systems meet business requirements and adhere to industry practices, but you will also have the opportunity to integrate cutting-edge data management...
-
Data Engineer
4 days ago
Sydney, New South Wales, Australia HiTech Group Full timeExciting opportunity within a Federal Government Department Initial 12 month contract with EXTENSION options Rewarding hourly rates $$$ One of Australia's principal Federal Government departments is looking to engage a skilled Data Engineer & Data Modeller to assist in collaborating with key business areas in the development and implementation of consumable...
-
Data Engineer
4 days ago
Sydney, New South Wales, Australia Experis ManpowerGroup Sp. z o.o. Full timeOur government client are looking for several data engineers to join their team on a contract basis.Please note only Australian Citizens will be considered as security clearance is required.Role Responsibilities and DutiesDesign, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack.Develop scalable architecture practices...
-
Data Engineer
3 weeks ago
Sydney, Australia Experis Full timeOur government client are looking for several data engineers to join their team on a contract basis.Please note only Australian Citizens will be considered as security clearance is required.Role Responsibilities and DutiesDesign, construct, and optimize data lakes, CI/CD, and Synapse pipelines within the Azure stack.Develop scalable architecture practices...
-
AWS Data Analyst
3 weeks ago
Sydney, Australia The Data Foundry Full timeJob DescriptionYour impact As an AWS Data Analyst, you will play a key role in working with customers to understand their business requirements, map these to their data capabilities, liaise with our internal Data Engineers to design and build elegant solutions, then partner with our customers to deploy those solutions in a way that allows them to turn data...
-
Data Engineer
4 days ago
Sydney, New South Wales, Australia Atlassian Full timeWe are looking for a Data Engineer to join our UIP - Frontend Observability team.The Frontend Observability team is part of the UI Platform organisation.Our team's mission is to help teams build fast experiences and make sure they stay fast. We build tools for measuring, monitoring and catching regressions in frontend performance.UI Platform delivers...
-
Data Engineering
4 days ago
Sydney, New South Wales, Australia Randstad Full timeAbout the company: My client is a leading global multinational investment banking and financial services company. You will be joining the data engineering team to help build the best technology company in the financial services industry. You will play a leading role in shaping and driving the next evolution of their data and analytics platform, providing...
-
data engineer
4 days ago
Sydney, New South Wales, Australia Opus Recruitment Solutions Full timeApplyData Engineer Sydney, Australia Permanent$ $130000 per annum Are you a skilled Data Engineer looking for your next challenge? I am currently seeking a Senior Data Engineer with expertise in Azure, Azure Data Factory, Databricks, Synapse, Power BI, and strong experience in SQL to join my clients dynamic team.Responsibilities:Designing, building, and...
-
Data Engineer
2 weeks ago
Sydney, Australia Practiv Full timeAs a Practiv Data Engineer you will join a team of passionate data-cloud technologists who help deliver end to end data engineering solutions for our customers from building data pipelines, warehousing the data and visualisation/presentation. Practiv Data Engineers understand both data pipeline development, operations and management as well as delivery of...
