
Data Engineer
4 weeks ago
We are seeking a highly skilled Data Engineer for a contract role focused on a critical data migration project. This is a hybrid position based in Melbourne, requiring 2 days in the office. The ideal candidate will have strong expertise in building and optimizing data pipelines in the Azure ecosystem.
Key Responsibilities:Design, develop, and manage robust data pipelines using Azure Data Factory (ADF) and Microsoft Fabric components.
Implement and optimize full and incremental data load strategies for a large-scale data migration.
Ensure data integrity and quality through meticulous transformation, cleansing, and validation using Python and PySpark.
Develop and manage complex SQL queries, stored procedures, and scripts for data extraction and loading.
Work extensively with Azure Storage (Blob & ADLS Gen2) and Azure SQL databases.
Collaborate with cross-functional teams to align data migration activities with business objectives and ensure high data quality.
5-6 years of hands-on experience in data engineering, data migration, and ETL development.
Strong expertise in Azure Data Factory (ADF), including pipeline design, performance tuning, and exception handling.
Proficiency in SQL and experience with SQL Server database design and optimization.
Experience with Azure Storage solutions (Blob, ADLS Gen2).
Knowledge of Python and PySpark for data transformation and cleansing.
Familiarity with Microsoft Fabric components (Dataflows, Pipelines, Lakehouse, and Warehouse) is a strong plus.
This is an excellent opportunity to play a key role in a high-impact data migration initiative.
#J-18808-Ljbffr-
Data Engineer
6 days ago
Melbourne, Victoria, Australia Tech & Data People Full time $80,000 - $120,000 per yearAre you the kind of engineer who loves solving tricky data problems, automating the boring stuff, and making things run faster and smarter? This role puts you right in the middle of a cloud-first data environment where you'll have the freedom to design, build and optimise pipelines, bring systems together, and use DevOps to keep everything running...
-
Data Consultant
7 hours ago
Melbourne, Victoria, Australia Ignite Data Solutions Full time $90,000 - $120,000 per yearAre you passionate about building data platforms, delivering business insights, or bringing machine learning models to life?Do you want to contribute to projects that enable the Australian Energy Transition?Want to expand your skills across cloud, machine learning, and modern BI platforms?At Ignite Data Solutions, we believe the best results come when data...
-
Machine Learning Engineer
2 weeks ago
Melbourne, Victoria, Australia Gamma Data Full time $438,000 - $511,000 per yearCompany DescriptionGamma Data is a team of data professionals specialising in building scalable, enterprise-grade data platforms using open source technologies. We provide services in Data Platform Engineering, Data Analytics & Machine Learning, Data Engineering, Cloud Data Infrastructure, Data Governance, and Data Strategy Consulting. Our mission is to help...
-
Principal Data Engineer
4 days ago
Melbourne, Victoria, Australia Tech & Data People Full time $250,000 per yearPrincipal Data Engineer – Melbourne – Hybrid - $250,000 - bleeding-edge Cloud & Data tech - enable next-gen analytics & AI Tech and Data People are working with a leading organisation that is driving large-scale digital and data transformation. We're looking for a Principal Data Engineer to design and deliver modern, secure, and scalable data...
-
Automation Engineer
1 week ago
Melbourne, Victoria, Australia Tech & Data People Full time $104,000 - $130,878 per yearWe're on the hunt for a skilled Automation Engineer who thrives in building frameworks from the ground up and enjoys working across modern cloud and data platforms. If you're passionate about quality engineering, data validation, and automation at scale—this is your opportunity to make a real impact.What You'll Be DoingDesigning and...
-
Data Engineer
2 days ago
Melbourne, Victoria, Australia ALOIS Solutions Full time $120,000 - $180,000 per yearRole: Data engineering platforms on Microsoft AzureDuration: 6 monthsJob Location: Melbourne, AUJob Description: Data engineering platforms on Microsoft AzureRoles and ResponsibilitiesDesign and implement scalable data engineering platforms on Microsoft Azure.Lead the setup and management of Azure-based data engineering environments.Develop and maintain...
-
Data Engineer
1 week ago
Melbourne, Victoria, Australia UCentric Full time $80,000 - $120,000 per yearData Engineer | Hybrid (Melbourne)We are partnering with a fast-growing technology organisation that is building out its data capability and looking for talented Data Engineers to join their team. This is a great environment if you're motivated by solving complex problems, working with cutting-edge tools, and growing your career with support and structure...
-
Data Engineer
10 hours ago
Melbourne, Victoria, Australia Morgan Consulting Full time $140,000 - $160,000 per yearRole: Data EngineerLocation: Melbourne CBD (Hybrid)Full Time Permanent PositionThis is an exciting opportunity to own and lead the data engineering function within a retail-driven business environment. You'll be the go-to expert, building pipelines, shaping the platform, and ensuring data is accurate, reliable, and ready to drive business performance.This...
-
MS Engineer
1 week ago
Melbourne, Victoria, Australia NTT DATA, Inc. Full time $60,000 - $90,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Managed...
-
Data Engineer
2 days ago
Melbourne, Victoria, Australia Turing Consulting Full time $104,000 - $130,878 per yearTuring Consulting is seeking several versatile and delivery-focusedData Engineerwith the following skillsRole OverviewWe are seeking a motivatedData Engineerwith hands-on experience inPySpark, SQL, and AWS Glueto join our growing team. The ideal candidate will have3+ yearsof strong technical expertise in building and optimizing data pipelines, an...