Data Engineer

5 days ago

Hawthorn East, Victoria, Australia Coles Full time
About the role

We are seeking a highly skilled Data Engineer to join our innovative Omnitech function at Coles Group. As a key member of our team, you will work on brand-new projects elevating our customer-facing platforms, focusing on AI and customer data.

Key responsibilities:

  • Design, construct, install, test, and maintain highly scalable data management systems.
  • Develop and implement data pipelines in Azure Data Factory (ADF).
  • Implement complex, scalable, and robust architecture to support real-time data streaming using Spark.
  • Work closely with data science and engineering teams to provide direct and indirect data-related support.
  • Ensure systems meet business requirements and industry practices.
  • Integrate up-and-coming data management and software engineering technologies into existing data structures.
  • Develop set processes for data mining, data modeling, and data production.
  • Research new uses for existing data.

About you

  • Bachelor's degree in Computer Science, Information Systems, or a related field.
  • Strong experience with Azure cloud services, Azure Data Factory (ADF) pipelines, PySpark, Snowflake, and Databricks.
  • Experience with Spark implementation and real-time data streaming in Spark.
  • Familiarity developing Azure Functions in Python.
  • Proficiency in SQL, Python, and other programming languages.
  • Familiarity with machine learning algorithms and data visualization tools is a plus.
  • Excellent analytical and problem-solving skills.
  • Strong communication skills and ability to work as part of a team.

What we offer

  • Flexible working options and a positive work-life balance.
  • Office perks, including a gym facility, fitness classes, free parking, and a fooderie hub.
  • Discounts across Coles brands and partner retailers.
  • Recognition and celebration through our digital recognition platform.
  • Opportunities for learning and development and job-specific training.
  • Paid parental leave and investment in your future through our annual team member share plan.

We are committed to creating a workplace that is safe and respectful for our team and welcome applications from people of all ages, cultures, abilities, sexual orientation, and gender identities.

  • Data Engineer

    4 weeks ago

    Hawthorn East, Victoria, Australia Michael Page Full time

    About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our dynamic team at Michael Page. The ideal candidate will have a broad experience in data engineering, particularly in Azure and PySpark-based data engineering applications.Key ResponsibilitiesDesign, construct, install, test and maintain highly scalable data management...

  • Data Engineer

    1 month ago

    Hawthorn East, Victoria, Australia Michael Page Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at Michael Page. As a Data Engineer, you will play a key role in designing, constructing, and maintaining highly scalable data management systems.Key ResponsibilitiesDesign and implement data pipelines in Azure Data Factory (ADF) to ensure seamless data flow and...

  • Data Engineer

    4 weeks ago

    Hawthorn East, Victoria, Australia Coles Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our innovative Omnitech function. As a Data Engineer, you will work on a number of brand new projects elevating our customer-facing platforms. You will have the opportunity to work in greenfield projects with a special focus on AI and customer data.Key ResponsibilitiesDesign, construct,...

  • Data Engineer

    3 weeks ago

    Hawthorn East, Victoria, Australia Coles Full time

    About the roleWe are seeking a highly skilled Data Engineer to join our innovative Omnitech function. As a Data Engineer, you will work on a number of brand new projects elevating our customer-facing platforms. You will have the opportunity to work in greenfield projects with a special focus on AI and customer data.Some of your key responsibilities will...

  • Data Engineer

    3 weeks ago

    Hawthorn East, Victoria, Australia Michael Page Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, particularly in Azure and PySpark-based applications.Key Responsibilities:Design and implement scalable data management systems using Azure Data Factory.Develop and maintain complex data pipelines to support...

  • Data Engineering Leadership Role

    1 week ago

    Hawthorn East, Victoria, Australia Coles Full time

    About the TeamColes Group is a leading retailer in Australia, and our Digital team is at the forefront of our digital transformation. As a Senior Data Engineer, you will play a key role in elevating our customer-facing platforms and working on greenfield projects with a focus on AI and customer data.About the RoleAs a Senior Data Engineer, you will be...

  • Data Engineer

    3 weeks ago

    Hawthorn East, Victoria, Australia Coles Full time

    About the RoleColes Group is seeking a highly skilled Data Engineer to join our innovative Omnitech function. As a Data Engineer, you will work on brand new projects elevating our customer-facing platforms, with a focus on AI and customer data.Key ResponsibilitiesDesign, construct, install, test, and maintain highly scalable data management systems.Develop...

  • Data Engineer

    3 weeks ago

    Hawthorn East, Victoria, Australia Michael Page Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at Michael Page. The ideal candidate will have a broad experience in data engineering, particularly in Azure and PySpark-based data engineering applications.Key ResponsibilitiesDesign, construct, install, test and maintain highly scalable data management systems.Develop and...

  • Data Engineer

    2 weeks ago

    Hawthorn East, Victoria, Australia Michael Page Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at Michael Page. As a Data Engineer, you will be responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems.Key ResponsibilitiesDesign and implement data pipelines in Azure Data Factory (ADF) to ensure seamless data...

  • AWS Data Analyst

    2 weeks ago

    Malvern East, Victoria, Australia The Data Foundry Full time

    Your ImpactAs a Data Insights Specialist at The Data Foundry, you will play a key role in working with customers to understand their business requirements and map these to their data capabilities. You will partner with our internal Data Engineers to design and build elegant solutions, then deploy those solutions in a way that allows customers to turn data...

  • AWS Data Analyst

    7 days ago

    Malvern East, Victoria, Australia The Data Foundry Full time

    Unlock Business Potential with Data-Driven InsightsAs a Data Analyst at The Data Foundry, you will play a pivotal role in helping customers leverage their data capabilities to drive business growth. With a focus on AWS solutions, you will work closely with customers to understand their needs, design elegant solutions, and deploy them to turn data into...

  • Data Scientist

    1 week ago

    Hawthorn East, Victoria, Australia Michael Page Full time

    About the RoleWe're seeking a highly skilled and experienced Data Engineer to join our dynamic team at Michael Page. As a key member of our data-centric team, you'll be responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems.Key ResponsibilitiesDesign and Implement Data Pipelines: Develop and...

  • AWS Data Analyst

    3 weeks ago

    Malvern East, Victoria, Australia The Data Foundry Full time

    About the RoleWe are seeking a highly skilled AWS Data Analyst to join our team at The Data Foundry. As a key member of our team, you will play a crucial role in working with customers to understand their business requirements and design elegant solutions using AWS.Key Responsibilities:Work with customers to understand their data-related challenges and...

  • AWS Data Analyst

    3 weeks ago

    Malvern East, Victoria, Australia The Data Foundry Full time

    Your ImpactAs a Data Insights Specialist at The Data Foundry, you will play a key role in working with customers to understand their business requirements and map these to their data capabilities. You will partner with our internal Data Engineers to design and build elegant solutions, then work with our customers to deploy those solutions in a way that...

  • Senior Data Solutions Architect

    3 days ago

    Hawthorn East, Victoria, Australia Michael Page Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our dynamic team at Michael Page. The ideal candidate will have a broad experience in data engineering, particularly in Azure and PySpark-based data engineering applications.Key Responsibilities:Design, construct, install, test and maintain highly scalable data management systems.Develop and...

  • AWS Data Analyst

    3 weeks ago

    Malvern East, Victoria, Australia The Data Foundry Full time

    About the RoleWe are seeking a highly skilled AWS Data Analyst to join our team at The Data Foundry. As a key member of our data team, you will play a crucial role in working with customers to understand their business requirements and design elegant solutions to meet their data-related challenges.Your ImpactAs an AWS Data Analyst, you will have the...

  • Advanced Data Architecture Specialist

    8 hours ago

    Hawthorn East, Victoria, Australia Coles Full time

    About the CompanyColes is a leading Australian retailer with a rich history dating back to 1914. With over 115,000 team members and a portfolio of iconic brands, we've grown to become a top 30-listed company on the ASX.Our commitment to serving Aussie communities has driven our success, and we're proud to be part of the fabric of Australian life.About the...

  • Senior Data Architect

    2 weeks ago

    Hawthorn East, Victoria, Australia Coles Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our innovative Omnitech function. As a Senior Data Engineer at Coles, you will work on a number of brand new projects, elevating our customer-facing platforms and focusing on AI and customer data. Your key responsibilities will include designing, constructing, installing, testing, and...

  • Data Quality Assurance Specialist

    1 month ago

    Hawthorn East, Victoria, Australia Michael Page Full time

    About the RoleWe are seeking a highly skilled Data QA Engineer to join our team at Michael Page. As a Data QA Engineer, you will be responsible for ensuring the quality and integrity of our data, identifying and resolving data-related issues, and collaborating with cross-functional teams to drive data-driven decision making.Key ResponsibilitiesDesign and...

  • Senior Data Architect

    1 week ago

    Hawthorn East, Victoria, Australia Coles Full time

    About the roleWe're looking for a Senior Data Engineer to join our innovative Omnitech function, working on brand new projects elevating our customer-facing platforms. You'll also have the opportunity to work in greenfield projects with a special focus on AI and customer data. Key responsibilities:Design, construct, install, test, and maintain highly...