Azure Data Engineer
1 week ago
Are you ready to take on a role where your work directly shapes how large-scale platforms operate, process massive datasets, and deliver actionable insights? We are seeking an experienced Senior Data Engineer to join a high-performing team working with some of the most advanced distributed systems in the industry.
In this role, you'll be building and optimising data pipelines that process tens of terabytes daily and manage multiple petabytes of data. Your expertise will be crucial in ensuring these systems are efficient, reliable, and low-latency, while maintaining compliance with privacy regulations. You'll work on transforming complex data into meaningful insights that drive decisions, improve compliance, and enhance customer experience.
What You'll Do:
- Own significant components of large-scale data systems, from design to implementation.
- Collaborate closely with product managers and partner engineering teams to design, build, and maintain features.
- Develop and refine data models, ensuring efficiency and scalability.
- Build robust data extraction, transformation, and merging processes.
- Design and maintain tools for data management, transformation, and accessibility.
- Monitor and troubleshoot data pipelines, creating visualisations and reports to track system health.
- Ensure data compliance and governance, including tagging, classification, and traceability.
What We're Looking For:
- 5+ years of Azure Data Engineering experience.
- 5+ years designing highly scalable data solutions for analytics, business intelligence, data science, or data engineering.
- Strong experience with big data tools (Spark/PySpark, Synapse, ADF, SQL, Kusto, Power BI, etc.).
- Expertise in data warehouse concepts and data lakes.
- Skilled in building reports/dashboards using Power BI and writing complex SQL.
- Experience working with cloud platforms such as Azure or AWS
-
Azure Data Engineer
1 week ago
Sydney, New South Wales, Australia AI Hustler Full time $104,000 - $130,878 per yearWe are urgently seeking a highly skilled and experiencedAzure Databricks Data Engineerto join our team in Sydney. This is a critical role for our data engineering function, focused on building robust, scalable, and efficient data solutions within the Azure cloud environment.If you have a passion for building complex data pipelines and thrive on solving...
-
Data Engineer
1 week ago
Sydney, New South Wales, Australia Data#3 Full time $90,000 - $120,000 per year3 month initial contract + potential extensionMix of WFH and Central Sydney officeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality...
-
Data Engineer
5 days ago
Sydney, New South Wales, Australia Data#3 Full timeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...
-
Data Engineer
6 days ago
Sydney, New South Wales, Australia Data#3 Full timeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...
-
Data Engineer
6 days ago
Sydney, New South Wales, Australia Data#3 Full timeOverview:We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.Responsibilities:Design, build, and maintain ETL pipelines using...
-
Azure Data Engineer
1 week ago
Sydney, New South Wales, Australia Robert Half Full time $90,000 - $120,000 per yearJob Description:Key Responsibilities: Design, develop, and monitor data ingestion pipelines from various sources. Continuously improve and optimize existing data pipelines for performance and scalability. Model data from API outputs into a relational format. Develop CI/CD pipelines using GitHub Actions. Provide support to ensure secure access to data for...
-
Azure Data Engineer
1 week ago
Sydney, New South Wales, Australia Robert Half Full time $90,000 - $120,000 per yearThis insurance firm is actively seeking a highly skilled Data Engineer to join their Data and Analytics team. The ideal candidate is adept at creating and optimizing data systems and has a strong background in data pipeline development and data wrangling. If you thrive in a collaborative environment and have a passion for data, this is the perfect...
-
Senior Azure Data Engineer
1 week ago
Sydney, New South Wales, Australia INGRITY Full time $120,000 - $140,000 per yearAre you a well-rounded Senior Azure Data Engineer with a passion for architecting scalable, efficient, and secure data solutions? Join our esteemed team at INGRITY, where your skills will play a crucial role in serving our clients effectively. Location: Sydney. Employment Type: Full-Time. Eligibility: Open to candidates with full working...
-
Microsoft Azure Data Engineer
1 week ago
Sydney, New South Wales, Australia Buscojobs Full timeWe are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining data architecture, models, and standards for Data Integration & Data Warehouse projects in Azure.Ensure new features and subject areas are integrated with existing structures to provide a consistent view.Develop and maintain documentation of data architecture, data...
-
Microsoft Azure Data Engineer
2 weeks ago
Sydney, New South Wales, Australia Buscojobs Full timeWe are looking for a Microsoft Azure Data Engineer responsible for developing and maintaining data architecture, models, and standards for Data Integration & Data Warehouse projects in Azure. Ensure new features and subject areas are integrated with existing structures to provide a consistent view. Develop and maintain documentation of data architecture,...