Data Engineer

3 weeks ago

Perth, Western Australia RAC of WA Full time

About the Role:

We are seeking an experienced Data Engineer to join our team at RAC of WA, where you will play a key role in enabling business growth by providing data-driven solutions.

Salary: $110k + super per annum

Job Description:

  • Data Ingestion and Transformation: You will be responsible for identifying, researching, and integrating new data sources into our Unified Data Platform (UDP) based on Microsoft Azure Synapse Analytics.
  • Data Pipeline Development: You will develop and maintain data ingestion pipelines using Azure Synapse Analytics, ensuring seamless integration with various data sources.
  • Monitoring and Sustaining Data Flows: You will monitor and sustain data flows, guaranteeing that all processes and data objects involved in data ingestion and transformation processes are well-documented.
  • Collaboration with Project Teams: You will collaborate with project teams and analysts to understand and meet their data needs, providing expert guidance on data provisioning for analytics and advanced analytics.
  • Data Model Design and Deployment: You will design, test, and deploy data transformations into production environments, building and maintaining robust data models as specified by analysts.
  • Cloud Expertise: You will leverage your expertise in cloud computing, specifically Azure Synapse Analytics, to create optimal solutions for pushing data from the UDP to other systems.
  • User Requirements Gathering: You will gather and document user requirements for data integration and data warehouse solutions, providing ad-hoc support to users of the UDP.

Requirements:

  • Tertiary Qualification: A bachelor's or master's degree in a quantitative field such as Computer Science, Information Management, Mathematics, Engineering, Economics, Finance, Statistics, or a Business/Commerce/Marketing discipline is mandatory.
  • Commercial Experience: Commercial experience in the field of Data Engineering, preferably in Azure, is required.
  • ETL Tools Proficiency: Demonstrated experience in the development of data transformation processes using ETL tools is essential.
  • Business Understanding: Understanding of business, particularly Motoring, Sales, Marketing, and Finance, is necessary.
  • Cloud Principles and Modern Data Warehousing: Experience with cloud principles and modern data warehousing in the Azure cloud is highly desirable.
  • Azure Synapse Analytics: Experience with Azure Synapse Pipelines, Azure Synapse Notebooks, Azure Data Lake, Azure Blob, Azure SQL Database, and Azure SQL Data Warehouse is required.
  • Differential Analysis: Experience working with Delta Lake and Data Warehouse is beneficial.
  • Metadata Framework: Experience working on Meta Data Driver Framework is advantageous.
  • OCI Familiarity: Familiarity with OCI is preferred.
  • Programming Skills: Proficiency in SQL, Pyspark, PySQL, and proficient in Microsoft Power BI or other Business Intelligence tool is essential.
  • Data Modelling Techniques: Knowledge of data modelling techniques and tools like ER diagrams, dimensional modelling, and tools like ERwin or Lucidchart is required.
  • Real-Time Data Processing: Desired knowledge/experience in real-time data processing and integration with Azure applications (such as MS Dynamics) is beneficial.
  • Relational Database Concepts: Understanding of relational database concepts and Data Warehousing concepts is necessary.
  • Structured and Unstructured Data: Experience in working with both structured and unstructured data is essential.
  • Problem-Solving Skills: Advanced problem-solving skills and meticulous attention to detail are necessary.
  • Business Intelligence and Reporting: An understanding of Business Intelligence and reporting concepts and an awareness of Business Intelligence toolsets is beneficial.
  • Information Management: A broad understanding of Information Management, Data Quality, Master Data Management, Data Governance, and Data Stewardship is not required but would be advantageous.
  • Microsoft Office Suite: Proficient in the use of Microsoft Word, Microsoft Excel, Microsoft PowerPoint, and Microsoft Outlook.

About Us:

RAC values inclusivity and promotes a workplace that actively seeks to welcome contributions from all people. We encourage people of all abilities, diverse cultures, and backgrounds to apply.

We offer complete flexibility to choose between working from home or office with flexible hours for a better work-life balance. Gain RAC Staff Benefits including free Roadside Assistance and 25% discount on insurances, Social Club access, and Fitness Passport for cheaper gym memberships.

  • Data Engineering Leader

    4 weeks ago

    Perth, Western Australia Databricks Full time

    Are you a highly skilled Data Engineering professional looking for a challenging role that will utilize your expertise in big data analytics?We are seeking an experienced Data Engineer to join our team at Databricks, a leading cloud-based data platform company.As a Data Engineer, you will be responsible for designing, developing, and deploying scalable data...

  • Data Engineering Professional

    3 weeks ago

    Perth, Western Australia Randstad Full time

    **About the Role**We are seeking a skilled Data Engineering Professional to join our team at Randstad Digital. This is a challenging role that requires collaboration with technical and non-technical stakeholders to develop and optimize data engineering processes.The ideal candidate will have expertise in creating and maintaining data pipelines,...

  • Data Engineering Specialist

    4 weeks ago

    Perth, Western Australia Randstad Full time

    Data engineering plays a vital role in the development and optimization of data processes within our platform. The key responsibilities include designing, building, and maintaining data pipelines, transformation scripts, and models to support efficient data ingestion and processing.This role requires collaboration with both technical and non-technical...

  • Data Engineering Specialist

    4 weeks ago

    Perth, Western Australia Randstad Full time

    Job SummaryWe are seeking a skilled Data Engineer to join our team at Randstad Digital. As a key member of our data engineering team, you will play a crucial role in developing and optimizing data engineering processes to support business needs.About the RoleThe successful candidate will be responsible for creating and maintaining data pipelines,...

  • Data Engineering Expert for Data Strategy

    3 weeks ago

    Perth, Western Australia DataDivers Full time

    We are seeking an experienced Senior Data Engineer to join our team in Perth, Australia.About the RoleThis is a senior position that requires a high level of expertise in data engineering and strategy. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines.You will work closely with...

  • Data Engineering Director

    4 weeks ago

    Perth, Western Australia HBF Australia Full time

    Job OverviewAt HBF Australia, we're seeking a seasoned leader to fill the role of Head of Data Engineering. This exciting opportunity will see you lead our data engineering function and drive business decision-making with accurate and relevant data.

  • Data Architect Lead

    4 weeks ago

    Perth, Western Australia DataDivers Full time

    We are seeking a skilled Senior Data Engineer to join our team in Perth, Australia. This is an excellent opportunity to work with a talented group of professionals who are passionate about data and analytics.About the RoleThe successful candidate will have a strong background in data engineering, with experience working with cloud platforms such as AWS,...

  • Data Engineer Leader

    1 month ago

    Perth, Western Australia Pyramid Global Technologies Full time

    About the JobAt Pyramid Global Technologies, we are seeking an experienced Data Engineer to lead our team in delivering high-quality data solutions. As a Data Engineer Leader, you will be responsible for designing, implementing, and maintaining large-scale data systems.Key Responsibilities:Design and develop scalable data pipelines using Azure and...

  • Data Engineering Leader

    3 weeks ago

    Perth, Western Australia HBF Australia Full time

    About UsHBF Australia is a leading health insurance provider with a strong presence in the Australian market. We're committed to delivering exceptional service and innovative solutions to our customers.Job SummaryWe're seeking an experienced Data Engineering Leader to join our team in Perth, Western Australia. As a key member of our data engineering...

  • Data Engineering Lead

    4 weeks ago

    Perth, Western Australia Pyramid Global Technologies Full time

    About the RoleWe are seeking an experienced Data Engineer to lead our team in developing and maintaining complex data systems.As a Senior Data Engineer at Pyramid Global Technologies, you will be responsible for designing, building, and deploying scalable data pipelines using Java, Scala, SQL, and Shell scripting.The ideal candidate will have a strong...

  • Cloud Data Engineering Specialist

    3 weeks ago

    Perth, Western Australia Aviva Full time

    About AvivaAviva is a leading insurance company that values data as the lifeblood of its operations. Our Quantum Data Science Practice covers various areas, including Machine Learning, Analytics, Data Engineering, AI, and more.We aim to provide our customers with the best products by leveraging data effectively. Our Data Engineering teams play a crucial role...

  • Data Engineer

    4 weeks ago

    Perth, Western Australia Brunel Full time

    Job DescriptionWe are seeking an experienced Data Engineer to join our team and contribute to the design and implementation of robust data models.About the RoleThis is an exciting opportunity for a skilled professional to work closely with data engineers, analysts, and business stakeholders to understand data requirements and translate them into effective...

  • Data Engineer Leader with Expertise in Cloud and Big Data

    3 weeks ago

    Perth, Western Australia Pyramid Global Technologies Full time

    About the JobWe are seeking a highly skilled Senior Data Engineer to join our team at Pyramid Global Technologies.The ideal candidate will have expertise in designing, building, and maintaining large-scale data processing systems using AWS services, such as Lambda, CloudWatch, and Glue.As a key member of our engineering team, you will work closely with...

  • Data Engineer

    4 weeks ago

    Perth, Western Australia RAC of WA Full time

    We are seeking an experienced Data Engineer to join our team at the Royal Automobile Club of Western Australia (RAC). As a Data Engineer, you will play a key role in enabling the business by providing data, reporting and analytics solutions. You will be responsible for developing and supporting data ingestion and transformation processes within our Unified...

  • Data Solutions Engineer

    4 weeks ago

    Perth, Western Australia RAC of WA Full time

    At RAC of Western Australia, we're seeking an accomplished Data Solutions Engineer to join our team. This is a unique opportunity to leverage your expertise in data engineering and analytics to drive business growth and improvement.The estimated salary for this role is $110,000 + superannuation.About the RoleWe're looking for someone who can design, develop,...

  • Data Engineer

    4 weeks ago

    Perth, Western Australia DataDivers Full time

    We are seeking a Senior Data Engineer to join our team at DataDivers, a dedicated consultancy for all things data and analytics. Our expertise spans data strategy, data platforms, DataOps, advanced analytics, data science, and building a data culture in our clients' organisations.About the RoleAs a results-driven organisation, we are committed to remarkable...

  • Cloud Data Engineering Specialist

    4 weeks ago

    Perth, Western Australia Aviva Full time

    At Aviva, we strive to make a better tomorrow for our customers and colleagues alike.About the RoleWe are seeking a talented Cloud Data Engineering Specialist to join our Data Engineering team within the Quantum Data Science Practice.The successful candidate will be responsible for designing, building, and maintaining scalable data pipelines across our...

  • Big Data Engineering Lead

    4 weeks ago

    Perth, Western Australia Pyramid Global Technologies Full time

    About Pyramid Global TechnologiesSalary Range: $120,000 - $180,000 per yearWe are seeking a highly skilled Big Data Engineering Lead to join our team at Pyramid Global Technologies.As a key member of our engineering team, you will be responsible for designing and developing big data systems, leveraging your expertise in programming skills for external data...

  • Chief Data Engineering Director

    2 weeks ago

    Perth, Western Australia HBF Health Full time

    Company Overview:HBF Health, a leading private health insurance provider in Western Australia, is expanding its national footprint and driving digital transformation. Our mission is to deliver exceptional customer experiences and make sound, data-driven decisions.Salary:The successful candidate will be offered a competitive salary of $180,000 +...

  • Data Engineering Specialist: Aviva's Quantum Data Science

    4 weeks ago

    Perth, Western Australia Aviva Full time

    Data Engineering Specialist: A Role at the Heart of Aviva's Quantum Data Science