Azure Data Engineer

7 days ago

Brisbane, Queensland, Australia Different Technologies Pty Ltd. Full time
About the Role

VALD is seeking an experienced data engineer to join our team and help shape the future of our Data Lakehouse in Azure Databricks.

We are looking for a skilled professional to maintain the health of our data ingestion and transformation pipelines, add new data sources, implement business rules, and produce new metrics to provide users with greater insights.

The ideal candidate will have proven data engineering experience with Azure technologies, including Azure Databricks, Azure SQL Database, and Azure Data Lake Storage.

They will also have proficiency in Spark SQL, Py Spark, and T-SQL programming languages, as well as experience developing CI/CD pipelines and following Dev Ops best practices.

The successful candidate will be based in Brisbane and must have full working rights in Australia.

Key Responsibilities
  • Maintain the health of VALD's data ingestion and transformation pipelines in Azure Databricks.
  • Add new data sources, implement business rules, and produce new metrics to provide users with greater insights.
  • Work closely with the Product team to develop new data models for VALD's expanding product suite.
  • Partner with the Data Science team to build new solutions that extend VALD's leadership in human movement technology.
  • Use vendor tools to monitor and improve the data quality and security in the Databricks lakehouse.
Requirements
  • Proven data engineering experience with Azure technologies.
  • Proficiency in Spark SQL, Py Spark, and T-SQL programming languages.
  • Experience developing CI/CD pipelines and following Dev Ops best practices.
  • Strong written and verbal communication skills.
Why VALD?

VALD is a fast-growing company that is revolutionizing the health and performance industries.

We offer a range of benefits, including industry-leading compensation, the opportunity to work in a company that is redefining allied healthcare, and the chance to learn from a range of high-performing individuals and teams.

We are committed to fostering an inclusive work environment and embracing diversity, including gender, nationality, disability, age, marital/parental status, ethnicity, gender identity, socioeconomic background, and sexual orientation.

  • Azure Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia VALD Full time

    About the RoleVALD is seeking an experienced Azure Data Engineer to join our team and help shape the future of our Data Lakehouse. As a key member of our data engineering team, you will be responsible for maintaining the health of our data ingestion and transformation pipelines in Azure Databricks, adding new data sources, implementing business rules, and...

  • Azure Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia Different Technologies Pty Ltd. Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team at Different Technologies Pty Ltd. as a key member of our Data Engineering team. As a Data Engineer, you will play a critical role in shaping the future of our Data Lakehouse, working closely with our Product and Data Science teams to design, develop, and maintain our cloud-based data...

  • Azure Data Engineer

    3 weeks ago

    Brisbane, Queensland, Australia Different Technologies Pty Ltd. Full time

    About the RoleVALD is seeking an experienced Data Engineer to join our team and help shape the future of our Data Lakehouse. As a key member of our Data Engineering team, you will be responsible for maintaining the health of our data ingestion and transformation pipelines in Azure Databricks, adding new data sources, implementing business rules, and...

  • Azure Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia Vald Performance Pty Full time

    About the RoleVALD is revolutionizing the allied health industry with innovative human-measurement technology. As a Data Engineer, you will play a critical role in shaping the future of our Data Lakehouse.Key ResponsibilitiesMaintain the health of VALD's data ingestion and transformation pipelines in Azure Databricks.Add new data sources, implement business...

  • Azure Data Engineer

    2 days ago

    Brisbane, Queensland, Australia Different Technologies Pty Ltd. Full time

    About the RoleVALD is revolutionizing the health and performance industries with cutting-edge technology. As a Data Engineer, you will play a crucial role in shaping the future of our Data Lakehouse.We are seeking an experienced professional to maintain the health of our data ingestion and transformation pipelines in Azure Databricks. The ideal candidate...

  • Azure Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia Vald Performance Pty Full time

    About the RoleVALD is revolutionizing the allied health industry with innovative human-measurement technology. As a key member of our team, you will play a crucial role in shaping the future of our Data Lakehouse.Key ResponsibilitiesMaintain and optimize data ingestion and transformation pipelines in Azure Databricks.Design and implement new data models for...

  • Data Engineering Specialist

    1 week ago

    Brisbane, Queensland, Australia Firesoft People Full time

    Cloud Data Engineering OpportunityFiresoft People is seeking a skilled Data Engineering professional to join our team. As a key member of our cloud data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data Factory, Azure...

  • Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia Softtest pays pty ltd Full time

    Job DescriptionAt Softtest pays pty ltd, we are seeking a highly skilled Data Engineer to join our team.Key Responsibilities:Design and develop scalable data architectures using Microsoft stack technologies, specifically SQL Managed Instance, Azure Synapse Analytics, and Azure Data Factory.Develop and maintain high-quality SQL code, ensuring optimal...

  • Data Engineer

    1 week ago

    Brisbane, Queensland, Australia Softtest pays pty ltd Full time

    Job DescriptionAt Softtest pays pty ltd, we are seeking a highly skilled Data Engineer to join our team.Key Responsibilities:Design and develop scalable data architectures using Microsoft stack technologies, specifically SQL Managed Instance, Azure Synapse Analytics, and Azure Data Factory.Develop and maintain high-quality SQL code, ensuring optimal...

  • Data Engineering Specialist

    2 weeks ago

    Brisbane, Queensland, Australia Firesoft People Full time

    About the RoleFiresoft People is seeking a highly skilled Data Engineering Specialist to join our team. As a key member of our organization, you will play a critical role in designing, developing, and maintaining our cloud-based data infrastructure.Key ResponsibilitiesDevelop and Implement Data Solutions: Design, develop, and deploy data technologies such as...

  • Data Engineering Specialist

    3 weeks ago

    Brisbane, Queensland, Australia Firesoft People Full time

    About the RoleFiresoft People is seeking a highly skilled Data Engineering Specialist to join our team. As a key member of our organization, you will play a crucial role in designing, developing, and maintaining our cloud-based data platform.Key ResponsibilitiesCloud Data Engineering: Design and implement scalable and secure data architectures on Azure,...

  • Data Engineering Manager

    2 weeks ago

    Brisbane, Queensland, Australia DFP Recruitment Full time

    EL1 Manager - Data EngineeringWe are seeking an experienced EL1 Manager - Data Engineering to lead our team in designing, developing, and implementing data architecture and repositories to support our strategic objectives.Key Responsibilities:Manage competing priorities to deliver project outcomes and effectively manage stakeholder relationships.Contribute...

  • Data Engineering Lead

    2 weeks ago

    Brisbane, Queensland, Australia eFinancialCareers Ltd. Full time

    Technical Lead - DataAbout the RoleWe are seeking a highly skilled and experienced Technical Lead - Data to join our Data and Insights team. This role is pivotal in leading the design, development, and implementation of our data solutions on Azure Cloud and Azure Databricks.Key Responsibilities:Design and Development:Oversee the design and implementation of...

  • Data Engineering Lead

    1 week ago

    Brisbane, Queensland, Australia Heritage and People's Choice Full time

    About the RoleWe are seeking a highly skilled and experienced Technical Lead - Data to join our Data and Insights team. This role is pivotal in leading the design, development, and implementation of our data solutions on Azure Cloud and Azure Databricks.This role is a key position in our organization, requiring a strong leader who can drive best practices,...

  • Data Engineering Manager

    2 weeks ago

    Brisbane, Queensland, Australia DFP Recruitment Full time

    About the Role:The Data Engineering Manager will be responsible for designing, developing, implementing, managing, and continuously enhancing the Agency's data architecture and repositories to address strategic objectives.Key Responsibilities:Effectively manage competing priorities during team planning to deliver project outcomes.Develop and manage a range...

  • Data Engineer

    5 days ago

    Brisbane, Queensland, Australia Firesoft People Full time

    Cloud Platform Upgrade ProjectFiresoft People is seeking a highly skilled Data Engineer to lead the upgrade of its cloud platform. This project will involve working with the latest technologies and tools to ensure a seamless transition.To be successful in this role, you will need to have:Excellent communication and interpersonal skills, with the ability to...

  • Data Engineering Lead

    1 week ago

    Brisbane, Queensland, Australia Heritage and People's Choice Full time

    About the RoleWe are seeking a highly skilled and experienced Technical Lead - Data to drive the design, development, and implementation of our data solutions on Azure Cloud and Azure Databricks.Key Responsibilities:Design and Development:Oversee the design and implementation of data pipelines, ETL processes, and data models on Azure Databricks, ensuring...

  • Data Engineer

    2 weeks ago

    Brisbane, Queensland, Australia Softtest pays pty ltd Full time

    Job Title: Data EngineerAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Softtest pays pty ltd. As a Data Engineer, you will play a critical role in designing, building, and maintaining our data infrastructure.Key Responsibilities:1. Microsoft Stack Expertise: Proven experience with Microsoft stack technologies, specifically...

  • Data Engineering Specialist

    2 weeks ago

    Brisbane, Queensland, Australia Firesoft People Full time

    About the RoleFiresoft People is seeking a highly skilled Data Engineering professional to join our team. As a key member of our cloud platform upgrade project, you will play a critical role in designing, developing, and supporting various data technologies.Key ResponsibilitiesDevelop and implement cloud automation solutions using Azure DevOps functions such...

  • Data Engineer

    1 week ago

    Brisbane, Queensland, Australia Flight Centre Travel Group Full time

    About Your OpportunityWe are seeking a skilled Mid Data Engineer to join our data team at Flight Centre Travel Group. As a leading online travel agency, we manage multiple eCommerce brands and are committed to creating an inclusive and diverse workplace.Key Responsibilities:Administrate and optimize Azure SQL and Postgres DatabasesLead data governance...