Data Engineer

5 days ago

West Perth, Australia RAC WA Full time

As a Data Engineer you will be enabling the business by providing data, reporting and analytics solutions, through developing and supporting Data Ingestion and transformation in our Unified Data Platform (UDP) based on Microsoft Azure Synapse Analytics.

What will you be doing?

Identifying, researching, and integrating new data sources into the Unified Data Platform.Developing and maintaining data ingestion pipelines using Azure Synapse Analytics.Monitoring and sustaining data flows, ensuring seamless integration with various data sources.Documenting all processes and data objects involved in the data ingestion and transformation processes.Collaborating with project teams and analysts to understand and meet their data needs.Designing, testing, and deploying data transformations into production environments.Providing expert guidance on data provisioning for analytics and advanced analytics.Building and maintaining robust data models as specified by analysts.Ensuring data solutions remain effective and update them as necessary.Offering expertise on the capabilities of Azure Synapse Analytics.Creating optimal solutions for pushing data from the Unified Data Platform to other systems.Gathering and documenting user requirements for data integration and data warehouse solutions.Providing ad-hoc support to users of the Unified Data Platform.

What are we looking for in you?

Tertiary qualification, Bachelors and ideally Masters in a quantitative field such as Computer Science, Information Management, Mathematics, Engineering, Economics, Finance, Statistics, or in a Business/Commerce/Marketing discipline is mandatory. Commercial experience in the field of Data Engineering, preferably in Azure.Demonstrated experience in the development of data transformation processes using ETL (Extract, Transform & Load) tools.Understanding of business, particularly Motoring, Sales, Marketing and Finance.Cloud Experience understanding of cloud principles and modern data warehousing in the Azure cloud. Experience of building solutions in Microsoft Fabric (Lakehouse, Synapse Data Engineering, Synapse Datawarehouse and Realtime Intelligence)Azure Synapse Analytics (Azure Synapse Pipelines, Azure Synapse Notebooks Azure Data Lake, Azure Blob, Azure SQL Database and Azure SQL Data Warehouse). Experience of working with Delta Lake and Data warehouse Experience of working on Meta Data Driver Framework Experience with OCIProficient in SQL, Pyspark, PySQL Proficient in Microsoft Power BI or other Business Intelligence toolKnowledge of data modelling techniques and tools like ER diagrams, dimensional modelling, and tools like ERwin or Lucidchart.Desired knowledge/experience in real time data processing and integration with Azure applications (such as MS Dynamics) Understanding of relational database concepts and Data Warehousing concepts.Experience in working with both structured and unstructured data. Advanced problem-solving skills and a meticulous attention to detail.An understanding of Business Intelligence and reporting concepts and an awareness of Business Intelligence toolsets. A broad understanding of Information Management, Data Quality, Master Data Management, Data Governance and Data Stewardship is not required, but would be beneficial. Proficient in the use of Microsoft Word, Microsoft Excel, Microsoft PowerPoint and Microsoft Outlook.

What can we offer you?

Working in an environment that is embracing a continuous improvement culture using experimentation to support learning.Time dedicated to your personal development time with access to training, development, and certification programs to ensure you can upskill.Being part of empowered, cross-functional agile delivery teams that works with the business to build systems that solve problems.Complete flexibility to choose between working from the home or office with flexible hours for a better work life balance.Building digital systems that will shape the future for the RAC and a better WA.Gain RAC Staff Benefits including free Roadside Assistance and 25% discount on your Insurances, Social Club and access Fitness Passport for cheaper gym memberships.

  • Senior Data Engineer

    2 weeks ago

    Perth, Western Australia Data Spree GmbH Full time

    Select how often (in days) to receive an alert: Fortescue is both a proud West Australian company and a global green solutions business. We are recognised for our culture, innovation and industry-leading development of infrastructure, mining assets and green energy initiatives. Work Location - Redcliffe WA (Relocation to Perth provided) Roster - Monday...

  • Senior Data Engineer

    2 weeks ago

    Perth, Western Australia Data Divers Pty Full time

    About DataDivers is a dedicated consultancy for all things data and analytics. Our expertise spans data strategy, data platforms, DataOps, advanced analytics, data science, and building a data culture in our clients' organisations. We are exceptional problem solvers who turn data into real business insights.As a results-driven organisation, we are committed...

  • Data Engineer

    47 minutes ago

    West Perth, Australia RAC of WA Full time

    As a Data Engineer you will be enabling the business by providing data, reporting and analytics solutions, through developing and supporting Data Ingestion and transformation in our Unified Data Platform (UDP) based on Microsoft Azure Synapse Analytics.What will you be doing?Identifying, researching, and integrating new data sources into the Unified Data...

  • Data Engineer

    2 months ago

    West Perth, Australia DataDivers.io Full time

    About DataDivers.ioDataDivers is a dedicated consultancy for all things data and analytics. Our expertise spans data strategy, data platforms, DataOps, advanced analytics, data science, and building a data culture in our clients’ organisations. We are exceptional problem solvers who turn data into real business insights.As a results-driven organisation, we...

  • Data Engineer

    4 weeks ago

    West Perth, Australia DataDivers.io Full time

    About DataDivers.ioDataDivers is a dedicated consultancy for all things data and analytics. Our expertise spans data strategy, data platforms, DataOps, advanced analytics, data science, and building a data culture in our clients’ organisations. We are exceptional problem solvers who turn data into real business insights.As a results-driven organisation, we...

  • Senior Data Engineer

    2 months ago

    West Perth, Australia DataDivers.io Full time

    About DataDivers.ioDataDivers is a dedicated consultancy for all things data and analytics. Our expertise spans data strategy, data platforms, DataOps, advanced analytics, data science, and building a data culture in our clients’ organisations. We are exceptional problem solvers who turn data into real business insights.As a results-driven organisation, we...

  • Senior Data Engineer

    4 weeks ago

    West Perth, Australia DataDivers.io Full time

    About DataDivers.ioDataDivers is a dedicated consultancy for all things data and analytics. Our expertise spans data strategy, data platforms, DataOps, advanced analytics, data science, and building a data culture in our clients’ organisations. We are exceptional problem solvers who turn data into real business insights.As a results-driven organisation, we...

  • data engineer

    2 weeks ago

    Perth, Western Australia Opus Recruitment Solutions Full time

    ApplyData Engineer Perth, Australia Permanent$ $150000 per annum Job Title: Data EngineerCompany Description: My client are a boutique tech-focused consultancy renowned for their vibrant work culture and commitment to innovation. They are seeking a talented Data Engineer to join the team in Perth.Job Description: As a Data Engineer, you will play a crucial...

  • Data Engineer

    2 weeks ago

    Perth, Western Australia Opus Recruitment Solutions Ltd Full time

    Job Title: Data EngineerCompany Description: My client are a boutique tech-focused consultancy renowned for their vibrant work culture and commitment to innovation. They are seeking a talented Data Engineer to join the team in Perth.Job Description: As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining their clients...

  • Data Engineers

    2 weeks ago

    Perth, Western Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia only respond. Must be able to obtain Baseline. Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and...

  • Data Engineers

    3 weeks ago

    Perth, Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia only respond. Must be able to obtain Baseline. Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and...

  • Data Engineer

    2 weeks ago

    Perth, Western Australia Pyramid Global Technologies Full time

    About the job Data Engineer Role Data Engineer Required Technical Skill Set 1) Strong Data Engineering skills using Azure and Pyspark 2) Good Knowledge on SQL 3) Preferred experience in Big data/Hadoop technologies like Spark, Hive, Hbase and Kafka. 4) Preferred experience in ETL process. 5) Good Communication Skills Desired Experience Range 5 – 10 years...

  • Data Engineer

    2 weeks ago

    Perth, Western Australia Verse Group Full time

    Data Engineer – EducationAre you a Data Engineer who thrives in a collaborative environment? We are working with one of Perth's established educational institutions to find a Data Engineer to play a vital role in ensuring data reliability, quality, and integrity.Role Overview:In this role, you'll be responsible for designing, building, and maintaining data...

  • Data Engineer

    2 weeks ago

    Perth, Western Australia RGIT Australia Full time

    Summary:Reporting to the Head of Professional Services our Data Engineers are responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our customers data-driven initiatives. Our Data Engineers collaborate closely with OneStep team members, customer teams and stakeholders to understand data requirements,...

  • Data Engineer

    2 weeks ago

    Perth, Western Australia ROBERT WALTERS AUSTRALIA Full time

    Focus: Business intelligence / data analytics Contract type: FULL_TIME Specialism: Information Technology Focus: Business intelligence / data analytics Industry: IT Salary: + super Workplace Type: Hybrid Experience Level: Associate Location: Perth FULL_TIME Consultant: Milena Wawrzyniak-Kalyanpur Job reference: /001 Date posted: 5 June 2024 ...

  • Data Engineer

    2 weeks ago

    Perth, Western Australia Paxus - Technology + Digital Talent Full time

    Collaborate with the project team and a multidisciplinary engineering team on innovative technology for heavy mining and railway equipment.Oversee test data management and data offloading pipeline for Green Fleet projects.Establish standards for data signal naming to ensure uniformity and consistency across the entire data pipeline.Design efficient database...

  • Data Engineering

    2 weeks ago

    Perth, Western Australia Green Light Full time

    Perth based Health Initial 5months +extensionAbout the company: Green Light is one of Australia's most successful and fastest-growing IT services businesses. We offer a wide range of IT services in Security, infrastructure, and Systems Integration to a diverse customer base throughout Australia, New Zealand, SE Asia, and Europe.About the engagement:Green...

  • Data Engineer

    2 weeks ago

    Perth, Western Australia Curtin University Full time

    Job Reference: 1169040Digital & Technology Solutions (DTS)Embark on an Exciting Tech Journey with Curtin UniversityAre you passionate about technology, innovation, and driving change? Join us as we celebrate the successful completion of our digital transformation at Curtin University, a forward-thinking institution leveraging major platforms like Amazon Web...

  • Data Engineer

    2 weeks ago

    Perth, Western Australia Verse Group Full time

    Data Engineer – Initial 6 month contract + extensionAre you a Data Engineer interested in working on cutting-edge technology for a global business?Join our client working for mobile heavy mining equipment and railway systems on an initial 6 month contract with possible 6 month extension. You will have a crucial role in their upcoming strategic initiatives...

  • Data Engineer

    1 week ago

    Perth, Australia Fortescue Full time

    About Us Fortescue is both a proud West Australian company and a global green solutions business. We are recognised for our culture, innovation and industry-leading development of infrastructure, mining assets and green energy initiatives. Our Opportunity Work Location - Redcliffe WA (Relocation to Perth provided) Roster - Monday to Friday ...