Mid Level Data Engineer

1 week ago


Perth, Western Australia Clarrow Full time

Are you a hands on and highly skilled Data Engineer? Join a high profile data transformation programme and play a key role in a global team.

We are searching for a Mid Level Data Engineer to join our global client to help develop innovative applications and analysis for a migration project in their commodities global markets team.

In This Role You Willbuild complex data models and work with the business to understand data requirements.

you will deliver insights from a wide range of data sources/databases as well as create reusable tools in Python/Java Script.a major part of the role will be documenting your findings using Confluence, Collibra and Alation.

This will all be done in an Agile environment.
What You Will Be Skilled In Strong data modelling experience with a background in Banking and Finance industry
Good SQL experience
Python experience
Experience with Collibra and Alation
Experience with Big Data querying tools like Hive, Spark, Presto
Knowledge of No SQL databases
Managed data pipelining with tools like Apache Oozie or Airflow
Knowledge of programming languages like Java, C++ or Scala in context of Big data technologies
Prior working experience with AWS - any of EC2, S3, EBS, ELB, RDS, Dynamo DB, EMR, Apache Parquet
API integration
Knowledge of real time integration using Collibra Kafka, Spark streaming or other technologies.

The key cultural attributes you will have are excellent communication skills both written and verbal and be a team player with the ability to forecast workloads and priorities for effective efficiencies.

If you tick these boxes and want to know more please reach out to Steve Bielbyon or email your CV
#J-18808-Ljbffr

  • Perth, Western Australia Clarrow Full time

    Are you a hands on and highly skilled Data Engineer? Join a high profile data transformation programme and play a key role in a global team.We are searching for a Mid Level Data Engineer to join our global client to help develop innovative applications and analysis for a migration project in their commodities global markets team.In This Role You Willbuild...


  • Perth, Western Australia Airswift Full time

    Mid-Level Mechanical EngineerAirswift is currently searching for a Mechanical Engineer at Intermediate level to join our client's team for an exciting major greenfield iron ore project. This role will contribute to the successful delivery of a preliminary engineering study focused on Non-Process Infrastructure.Key Highlights:Work with a Global Professional...


  • Perth, Western Australia Airswift Full time

    Location Perth, Western Australia, United States Job Type Contract Date Added May 24, 2024 Mid-Level Mechanical Engineer Airswift is currently searching for a Mechanical Engineer at Intermediate level to join our client's team for an exciting major greenfield iron ore project. This role will contribute to the successful delivery of a preliminary...


  • Perth, Western Australia Data Spree GmbH Full time

    Select how often (in days) to receive an alert: Fortescue is both a proud West Australian company and a global green solutions business. We are recognised for our culture, innovation and industry-leading development of infrastructure, mining assets and green energy initiatives. Work Location - Redcliffe WA (Relocation to Perth provided) Roster - Monday...


  • Perth, Western Australia Data Divers Pty Full time

    About DataDivers is a dedicated consultancy for all things data and analytics. Our expertise spans data strategy, data platforms, DataOps, advanced analytics, data science, and building a data culture in our clients' organisations. We are exceptional problem solvers who turn data into real business insights.As a results-driven organisation, we are committed...


  • Perth, Western Australia Australian Broadcasting Corporation Full time

    Apply nowJob no:504009Work type:Contract Full TimeLocation:VariousCategories:IT/TechnologyAbout The ABCThe ABC is the nation's most trusted and independent source of Australian conversations, culture, and stories. With over 4,000 employees from diverse backgrounds across over 50 locations around Australia and overseas, we are proud to create, curate and...

  • Data Engineers

    1 week ago


    Perth, Western Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia only respond. Must be able to obtain Baseline. Overview At the Clean Energy Regulator, youre signing up for a challenging and rewarding workplace. All our work is connected to measuring, managing, reducing or offsetting carbon emissions and increasing the use of clean energy in Australia. Role Responsibilities and...


  • Perth, Western Australia Lawyers On Demand Limited Full time

    LOD (Lawyers on Demand) is one of the world's largest and fastest growing flexible legal services businesses.Continuing to lead the market we created, our lawyers have completed hundreds of secondments with the world's leading companies. We're a global business with offices around the world that focus on providing end-to-end solutions for our clients' legal...

  • Data Engineer

    1 week ago


    Perth, Western Australia ROBERT WALTERS AUSTRALIA Full time

    Focus: Business intelligence / data analytics Contract type: FULL_TIME Specialism: Information Technology Focus: Business intelligence / data analytics Industry: IT Salary: + super Workplace Type: Hybrid Experience Level: Associate Location: Perth FULL_TIME Consultant: Milena Wawrzyniak-Kalyanpur Job reference: /001 Date posted: 5 June 2024 ...


  • Perth, Western Australia GeoMoby Pty Ltd Full time

    Mid to Senior Level Mobile Developer (Swift/Kotlin) Developers/Programmers (Information & Communication Technology) Geo Moby is a cutting-edge technology company based in Perth, Australia, specialising in location intelligence and real-time tracking solutions for a wide range of industries with a current focus on the mining industry. Established in 2013, Geo...


  • Perth, Western Australia GeoMoby Pty Ltd Full time

    Mid to Senior Level Mobile Developer (Swift/Kotlin) Developers/Programmers (Information & Communication Technology) GeoMoby is a cutting-edge technology company based in Perth, Australia, specialising in location intelligence and real-time tracking solutions for a wide range of industries with a current focus on the mining industry. Established in 2013,...

  • data engineer

    1 week ago


    Perth, Western Australia Opus Recruitment Solutions Full time

    ApplyData Engineer Perth, Australia Permanent$ $150000 per annum Job Title: Data EngineerCompany Description: My client are a boutique tech-focused consultancy renowned for their vibrant work culture and commitment to innovation. They are seeking a talented Data Engineer to join the team in Perth.Job Description: As a Data Engineer, you will play a crucial...

  • Data Engineer

    1 week ago


    Perth, Western Australia Opus Recruitment Solutions Ltd Full time

    Job Title: Data EngineerCompany Description: My client are a boutique tech-focused consultancy renowned for their vibrant work culture and commitment to innovation. They are seeking a talented Data Engineer to join the team in Perth.Job Description: As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining their clients...


  • Perth, Western Australia Professional Search Group Full time

    The CompanyWe are excited to present a fantastic opportunity for a seasoned Data Engineer Lead within a national organization located in Perth's eastern suburbs. This company is a pioneer in its field and is seeking a Lead to steer the strategic direction of the Data Engineering team. As the chosen candidate, you will play a crucial role in shaping the...

  • Data Engineer

    1 week ago


    Perth, Western Australia Pyramid Global Technologies Full time

    About the job Data Engineer Role Data Engineer Required Technical Skill Set 1) Strong Data Engineering skills using Azure and Pyspark 2) Good Knowledge on SQL 3) Preferred experience in Big data/Hadoop technologies like Spark, Hive, Hbase and Kafka. 4) Preferred experience in ETL process. 5) Good Communication Skills Desired Experience Range 5 – 10 years...

  • Data Engineer

    1 week ago


    Perth, Western Australia Verse Group Full time

    Data Engineer – EducationAre you a Data Engineer who thrives in a collaborative environment? We are working with one of Perth's established educational institutions to find a Data Engineer to play a vital role in ensuring data reliability, quality, and integrity.Role Overview:In this role, you'll be responsible for designing, building, and maintaining data...

  • Data Engineer

    1 week ago


    Perth, Western Australia RGIT Australia Full time

    Summary:Reporting to the Head of Professional Services our Data Engineers are responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our customers data-driven initiatives. Our Data Engineers collaborate closely with OneStep team members, customer teams and stakeholders to understand data requirements,...


  • Perth, Western Australia Airswift Full time

    Airswift is a global workforce solutions provider specializing in the energy, process, and infrastructure sectors. They work closely with clients to deliver top talent for successful projects, tailored to each client's specific needs.Position: Environmental / Regulatory AdvisorLocation: Dockland, MelbourneDuration: 12 Months ContractKey Responsibilities:Plan...

  • Data Engineer

    1 week ago


    Perth, Western Australia Paxus - Technology + Digital Talent Full time

    Collaborate with the project team and a multidisciplinary engineering team on innovative technology for heavy mining and railway equipment.Oversee test data management and data offloading pipeline for Green Fleet projects.Establish standards for data signal naming to ensure uniformity and consistency across the entire data pipeline.Design efficient database...

  • Data Engineering

    1 week ago


    Perth, Western Australia Green Light Full time

    Perth based Health Initial 5months +extensionAbout the company: Green Light is one of Australia's most successful and fastest-growing IT services businesses. We offer a wide range of IT services in Security, infrastructure, and Systems Integration to a diverse customer base throughout Australia, New Zealand, SE Asia, and Europe.About the engagement:Green...