Azure Data Engineer

Found in: beBee S AU - 4 weeks ago


Brisbane, Australia Randstad Australia Remote Work Freelance Full time

Randstad Data is working with a State Government Department to find a Data Engineer to play a pivotal role in constructing an enterprise-grade data and analytics platform. This role is perfect if you thrive in designing and optimising data systems, with a love for building robust data pipelines from the ground up. You will collaborate closely with software architects, analysts, and data scientists to ensure seamless data delivery across ongoing projects. This role is a 12-month contract with extensions.

Responsibilities:

  • Design, develop, and maintain scalable data pipelines and ETL processes for efficient collection, processing, and storage of large volumes of structured, semi-structured, and unstructured data.
  • Implement data integration solutions to consolidate data from various sources, ensuring consistency and integrity.
  • Utilise analytical tools and techniques to explore, analyse, and visualise data, uncovering trends, patterns, and insights crucial for business decision-making.
  • Develop dashboards and reports to communicate key metrics and findings to stakeholders in a clear and actionable manner.
  • Identify opportunities to optimise data processing and storage systems for improved performance, scalability, and efficiency.
  • Implement monitoring and alerting mechanisms to proactively detect and address issues impacting data pipeline reliability and performance.
  • Enforce data governance policies and standards to ensure compliance with regulatory requirements, protecting data privacy and security.

    Necessary Skills:

    • Experience with data warehousing concepts, relational and non-relational databases, and big data technologies.
    • Experience with medallion data architecture, Azure data stack and emerging technologies â ADLS Gen 2, Azure Data Factory, Azure Synapse Analytics, Databricks and Fabric.
    • Proficiency in data visualisation tools such as Tableau, Power BI, or matplotlib.
    • Proven experience in data engineering, including designing and implementing data pipelines, ETL processes, and data integration solutions.
    • Strong proficiency in programming languages such as Python and R for data manipulation, analysis, and visualisation.
    • Strong hands-on experience with SQL for database development and complex query design.
    • Knowledge of machine learning algorithms and techniques for classification, regression, clustering, and anomaly detection.
    • Familiarity with analytical tools and techniques for data exploration, statistical analysis, and predictive modelling.

      And all Randstad Digital contractors receive:

      • Access to a Udemy license for ongoing learning and continuous professional development
      • Access to exclusive discounts
      • Discounts on certain health funds
      • Discounts on health programs including SWEAT by Kayla Itsines
      • Novated leasing options

        Interested? Apply Now

        Send your application by clicking âApply Nowâ, or send your application to sian.asnicar@randstaddigital.com.au

        At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.


        skills

        Data Engineering, ETL, Azure

        qualifications

        • Relevant Qualifications

          education

          Bachelor Degree


  • Data Platform Engineer

    Found in: beBee S AU - 4 weeks ago


    Brisbane, Australia Randstad Australia Remote Work Freelance Full time

    Randstad Digital are seeking a highly skilled and experienced Azure Data Platform Engineer to join our team. In this role, you will play a pivotal role in driving the design, implementation, and maturation of our client cloud-based data analytics infrastructure for key data-centric projects. If you are passionate about leveraging Azure technologies to drive...

  • Intelligent Data Platform

    Found in: Talent AU C2 - 20 hours ago


    Brisbane, Australia Avanade Full time

    Intelligent Data Platform - Data Engineering ConsultantLeading organisations – corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interesting work that is well supported, always evolving and sure to keep you engaged and...

  • Data Engineer

    Found in: Talent AU C2 - 3 weeks ago


    Brisbane, Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia with Baseline Clearance only respond.Contract start 14 April 2023 to 12 months, 12 months extensions.Australian Citizen, Baseline Clearance, Canberra or Brisbane, Hybrid role.Send your responses to jobs@softtestpays.comOverviewData Engineer Understand complex information systems and design effective data...

  • Intelligent Data Platform

    Found in: Talent AU C2 - 2 days ago


    Brisbane, Australia Avanade Full time

    Intelligent Data Platform - Data Engineering ConsultantLeading organisations – corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interesting work that is well supported, always evolving and sure to keep you engaged and...


  • Brisbane, Australia Avanade Full time

    Come join us As a Data Engineering Manager at Avanade, you will use comprehensive modern data engineering techniques and methods to support business decisions for Avanade clients. You can collect, aggregate, and analyse structured and unstructured data from multiple internal and external sources and patterns, insights, and trends to decision-makers. Your...

  • Intelligent Data Platform

    Found in: Talent AU C2 - 2 days ago


    Brisbane, Australia Avanade Full time

    Intelligent Data Platform - Data Engineering ManagerLeading organisations – corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interesting work that is well supported, always evolving and sure to keep you engaged and...

  • Data Engineering

    Found in: Talent AU C2 - 2 weeks ago


    Brisbane, Australia Firesoft People Full time

    My client is about to embark on updating its cloud platform. This project will see you working with the latest & greatest if you are looking for something to kick off your new Financial year... This upgrade project is for you! To be successful in this role you will have -  Written and oral communications skills including the ability to negotiate,...

  • Software Engineer- Azure Core Trusted Platform

    Found in: Talent AU C2 - 3 weeks ago


    Brisbane, Australia Microsoft Full time

    Overview Microsoft is built on trust, and Azure is dedicated to becoming the most trusted cloud service for its customers. As Azure expands its services, certifications, and regions for its global customers, there is a growing need for increased support to uphold customer promises. The Azure Core Trusted Platform team is committed to enabling product...

  • Azure Monitoring Engineer

    Found in: Talent AU C2 - 3 weeks ago


    Brisbane, Australia Softtest pays pty ltd Full time

    Australian Citizens residing in Australia with ability to obtain Baseline Clearance only respond.Contract start 06 November 2023 to 12 months, 2 x 12 months extensions.Australian Citizen, ability to obtain Baseline Clearance, Canberra, Brisbane, Offsite role.Send your responses to jobs@softtestpays.comOverviewThe Department of Agriculture, Fisheries and...

  • Software Engineer II

    Found in: Talent AU C2 - 2 weeks ago


    Brisbane, Australia Microsoft Full time

    OverviewAre you passionate about developing top-notch solutions for Azure Kubernetes Service customers? If so, we have an exciting opportunity for you! Azure Kubernetes Service is at the forefront of innovation, leveraging cutting-edge technologies to deliver exceptional solutions to Azure customers.As a Software Engineer II, on the Azure Kubernetes Service...

  • Data Platform Lead

    6 days ago


    Brisbane, Australia HUMANISED GROUP Full time

    In this role you will be joining an exceptional data and product to lead a Data Migration project. You will have the opportunity to work on and introduce new and innovative technologies with a focus on Data Engineering, Data Architecture and Governance. What you will be doing: - 70 % of this role will focus on Designing, developing, implementing and owning...

  • DevOps Engineer – Azure, CI/CD, Docker, Node, React

    Found in: Talent AU C2 - 2 weeks ago


    Brisbane, Australia Expertech Full time

    Azure DevOps Engineer – CI/CD, Docker, Node, React, API The Azure DevOps Engineer will deliver expert advice on Cloud Security development within an Azure environment. Collaborate closely with Product Management, Solution Architecture, stakeholders, and governance teams to deliver solutions aligning with architectural requirements, across an Australian...

  • Senior Software Engineer- Azure Core Trusted Platform

    Found in: Talent AU C2 - 2 weeks ago


    Brisbane, Australia Microsoft Full time

    OverviewMicrosoft is built on trust, and Azure is dedicated to becoming the most trusted cloud service for its customers. As Azure expands its services, certifications, and regions for its global customers, there is a growing need for increased support to uphold customer promises. The Azure Core Trusted Platform team is committed to enabling product teams to...

  • Software Engineer II

    Found in: Talent AU C2 - 2 weeks ago


    Brisbane, Australia Microsoft Full time

    OverviewAre you passionate about building world-class, fast, scalable, container workloads? Are you looking for an opportunity to enable and have great impact on how developers work on these workflows? If you are a mid-level Software Engineer, you can benefit from the unique opportunities that Microsoft offers. You can boost your career, acquire deep...


  • Brisbane, Australia Bank of Queensland Full time

    **About the Role** An exciting opportunity to join BOQ Group (which includes Bank of Queensland, Virgin Money Australia and ME Bank) as a Data Engineering Manager has arrived! Do you want be part of a large digital transformation that is moving from legacy systems to a single cloud environment? Then look no further! By joining the digital bank of the future,...

  • Senior Software Engineer- Azure Core Trusted Platform

    Found in: Talent AU C2 - 3 weeks ago


    Brisbane, Australia Microsoft Full time

    Overview Microsoft is built on trust, and Azure is dedicated to becoming the most trusted cloud service for its customers. As Azure expands its services, certifications, and regions for its global customers, there is a growing need for increased support to uphold customer promises. The Azure Core Trusted Platform team is committed to enabling product...

  • Cloud Engineer

    Found in: Talent AU C2 - 2 weeks ago


    Brisbane, Australia Hudson Full time

    Large Health Organisation Mostly remote work 6 month contract that will very likely extendJoin this Organisation as a specialised Cloud Automation Engineer. This team operates as an internal consultancy, so you'll work collaboratively with likeminded Cloud Engineers in your space. If your skillset is predominantly focussed around one Public Cloud offering,...

  • Technical Ba

    3 days ago


    Brisbane, Australia Powerdata Group Consulting Full time

    **Technical BA - Azure Development & Integration Projects** **Brisbane Based role - Hybrid** - This. household acclaimed and highly respected company is actively seeking a talented Technical Business Analyst to permanently join the team. You will be working on an Azure software development and integration project.**Skills** - Experience with Azure cloud and...

  • Software Engineer

    Found in: Talent AU C2 - 3 days ago


    Brisbane, Australia Microsoft Full time

    OverviewThe Azure Networking team continues to innovate across the stack, pushing new scale and features into the cloud and desktop platforms while transforming our infrastructure to meet the growing needs of the 200-plus Microsoft online services, including Bing, MSN, Office 365, Xbox Live, Skype, OneDrive and several hundred thousand customers using Azure...


  • Brisbane, Australia HUMANISED GROUP Full time

    **About the company and the role**: This company operates across the globe, with 40,000 + employees. This company prides themselves on innovation, progressive thinking, cutting edge technology and most importantly integrity. Your key responsibility will be leading the delivery of an enterprise data platform with a focus on data architecture and data...