Senior Data Engineer

3 weeks ago


Brisbane, Queensland, Australia Randstad Australia Full time

Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platform

Key Responsibilities & Deliverables:

Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a unified view.Ensure data accuracy and compliance with governance policies.Optimise infrastructure for data processing and performance.Build scalable, reliable data systems for large volumes.Implement security measures for data privacy.Collaborate with BI developers, data modelers, scientists, stakeholders, and tech partners.Evaluate new technologies to enhance data capabilities.Troubleshoot data issues for smooth operations.Support data-driven decisions by ensuring data availability and accessibility. Necessary Skills & Qualifications: 5+ years as a Data Engineer with Azure cloud experience.Proficiency in Azure Databricks, PySpark, Spark SQL, and cluster management.Experience in Data Lake or Lake House solutions with Azure Databricks.Advanced skills in Azure Data Factory or similar tools.Knowledge of Azure DevOps or equivalent.Expertise in Python, Spark SQL, SQL, and ETL techniques.Experience with REST API data extraction.Ability to work autonomously and collaboratively.Results-oriented with a growth mindset.Strong analytical and interpersonal skills.Solid background in data analysis and frameworks.Experience as a dedicated data modeler would be highly regarded.
Interested? Apply Now Send applications by clicking "Apply Now" and following the prompts, or alternatively send your updated CV to At Randstad Digital, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.
skills Azure, Cloud, Data Engineer, Senior Data Engineer, ETL,SQL
qualifications 5+ years as a Data Engineer with Azure cloud experience.
education Associate Degree/Diploma

  • Brisbane, Queensland, Australia Blackroc Full time

    BLACKROC are seeking a Senior Data Engineer for a global technology business who will play a crucial role in designing, building, and optimising data infrastructures, collaborating with senior stakeholders and mentoring team members.You'll be joining a newly formed team charged with owning, operating and improving mission-critical data infrastructure that's...


  • Brisbane, Queensland, Australia Randstad Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platformKey Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a...


  • Brisbane, Queensland, Australia HKT Full time

    This is a full-time position with hybrid working arrangement (1-2 days in office) Role Overview We are passionate about harnessing the power of data to drive innovation and empower businesses. We are seeking a highly technical and experienced Senior Data Engineer to join our dynamic team. The successful candidate will be a key player in designing,...


  • Brisbane, Queensland, Australia HTK Full time

    This is a Full-time position with a Hybrid working model.About Console ConnectConsole Connect by PCCW Global focuses on simplifying business connectivity to the cloud, offering dedicated and secure connections to cloud service providers worldwide. It is the pioneer global software-defined interconnection platform, making business connectivity more accessible...


  • Brisbane, Queensland, Australia HUMANISED GROUP Full time

    Are you a skilled Data Engineer/Developer looking for an exciting opportunity in the energy sector? Join our client's dynamic project team and be part of a transformation with significant impact12 month contract position.Located right here in Brisbane's CBD.Hybrid working arrangement.As the sole technical member in a team of 3-4, you'll collaborate closely...


  • Brisbane, Queensland, Australia Compare the Market Full time

    Engineering - Software (Information & Communication Technology) Full time Add expected salary to your profile for insights This job ad is the universe's way of telling you that you're currently in the wrong job.Compare the Market – yes, the one with the meerkats – is a high-growth FinTech company on a transformational journey. We are focused on...


  • Brisbane, Queensland, Australia BAE Systems Full time

    Job Details Here's how the job details align with your profile. Job Type Permanent Full-time Location Australia Full Job Description At BAE Systems Australia Do meaningful work that MATTERS ENJOY what you do GROW your career Be YOURSELF We operate in a thriving sector that leads us to exciting and valuable work. Each day, we innovate to...


  • Brisbane, Queensland, Australia HUMANISED GROUP Full time

    Are you a skilled Data Engineer/Developer looking for an exciting opportunity in the energy sector? Join our client's dynamic project team and be part of a transformation with significant impact12 month contract position.Located right here in Brisbane's CBD.Hybrid working arrangement.As the sole technical member in a team of 3-4, you'll collaborate closely...


  • Brisbane, Queensland, Australia Humanised Group Full time

    Are you a skilled Data Engineer/Developer searching for an exciting opportunity in the energy sector? Join our client's dynamic project team and be part of a transformation with significant impact.12-month contract position.Excellent day rate.Located in Brisbane's CBD.Hybrid working arrangement.As the sole technical member in a team of 3-4, you'll...


  • Brisbane, Queensland, Australia Randstad Full time

    Randstad Digital are seeking a highly skilled and Senior Data Engineer to play a crucial role in designing, developing, and deploying data pipelines for our client's lake house platformKey Responsibilities & Deliverables:Design and maintain data pipelines for ETL processes.Create data models to meet business needs.Integrate data from various systems for a...


  • Brisbane, Queensland, Australia Suncorp Group Full time

    Drive the technical vision for implementing new cloud data platform on Databricks to support Data Warehousing, Data Science and Gen AI use cases Experience implementing Databricks along with defining patterns and frameworks Empower and guide a high performing, collaborative team We're never just satisfied with how things are – because we know how...


  • Brisbane, Queensland, Australia KPMG Full time

    Our Enterprise Technology and System Integration team brings together skills in intelligent automation, data engineering and software integration to help our clients align their technology capabilities with their strategic and operational objectives. We also draw on KPMG's extensive national and global resources, adopting a multidisciplinary approach to...


  • Brisbane, Queensland, Australia Michael Page Full time

    About Our Client This globally recognised organisation is an industry leader, founded on over a century of history. With over 8000 staff globally, they are well on their way to transforming the business into a leading Digital and Data led organisation by 2025. A large part of this is building upon and enhancing their newly created Global Azure Data...


  • Brisbane, Queensland, Australia StudentUniverse Full time

    Search and refine your job...Work Type: - Full-timeRegion: - AustraliaLocation: - QueenslandBrand: - Product and TechnologyCategory: Information & TechnologyWe are in need of a Senior Azure Data Engineer to join our Global Data Engineering team. As part of this role, you will be crucial in designing, developing, and implementing data pipelines for Flight...

  • Data Engineer

    6 days ago


    Brisbane, Queensland, Australia u&u Full time

    Our client is seeking an experienced Data Engineer to join a dynamic Data Team. As a Data Engineer, you will play a critical role in designing and maintaining the data architecture, ensuring data quality and actionable insights. If you have experience in data engineering and a passion for leveraging data to drive business value, we want to hear from you. Our...

  • Data Engineer

    5 days ago


    Brisbane, Queensland, Australia u&u Full time

    Our client is seeking an experienced Data Engineer to join a dynamic Data Team. As a Data Engineer, you will play a critical role in designing and maintaining the data architecture, ensuring data quality and actionable insights. If you have experience in data engineering and a passion for leveraging data to drive business value, we want to hear from you.Our...


  • Brisbane, Queensland, Australia KPMG Full time

    Data Engineer Opportunity at Our CompanyWe are looking for a talented Data Engineer to join our Data Migration team. In this role, you will be pivotal in developing ETL processes on Azure Synapse for seamless data migration from clients' on-premise systems to new SaaS platforms. If you're a problem-solver with strong expertise in ETL and Azure Data Factory /...

  • Data Engineers

    6 days ago


    Brisbane, Queensland, Australia CYOS Solutions Full time

    Application closing date: Friday, 14 June 2024 • 11:59pm, Canberra timeEstimated start date: Monday, 01 July 2024Location of work: QLDWorking arrangements: The team is based in Canberra however, working from home arrangements are considered subject to home-based work application and suitability. Interstate candidates will also be considered. However, there...


  • Brisbane, Queensland, Australia PM&E Full time

    Opportunity to attend global awards events, including Global Gathering . Various social events to promote networking, the celebration of wins, and sometimes just for fun A day in the life... Design, develop, and maintain data pipelines for extracting, transforming, and loading data from various sources into lake house. Create and implement data...

  • Senior Data Analyst

    6 days ago


    Brisbane, Queensland, Australia NBN Co Full time

    Job Expectations Build your career and Australia's future. Not many people can say they are working on building Australia's future. With us you'll be doing just that, leaving a legacy for all Australians. Plus, there's equal employment, great training, and true flexible working arrangements. A bit about your role The Senior Data Analyst supports...