Data Engineer | Generative AI

4 weeks ago


Melbourne, Australia Deloitte Full time

Data Engineer

Training and development to build your skills and career - at Deloitte we believe in investing in our best assets, our people You will have access to world class training and funding towards industry and other professional certifications Flexible work arrangements - work in a way that suits you best Rewards platform - your hard work won't go unnoticed at Deloitte

What will your typical day look like?

The Data Engineer will be a key member of our team. This role involves constructing robust and scalable data pipelines, exploring and implementing generative algorithms, and facilitating the seamless flow of data between computational systems. You will collaborate with a multidisciplinary team of Data Scientists & Machine Learning Engineers to meet organisational objectives and supports the Engineering Lead in the execution of the GenAI SDT program of work. 

You will be responsible for:

The design, development and maintenance of our platform and client solutions based on technologies including: 

UNIX/Linux, Docker, Kubernetes, OpenShift v3 Ansible, Git  Cloud technologies and platforms such as Amazon AWS and Azure  Analytics and search platforms (ElasticSearch)  Messaging platforms (ActiveMQ, AWS SQS and SNS)  Java, Maven  API and ESB platforms (e.g. MuleSoft, Redhat)  Transition to BaU plus ongoing development of client solutions 

Key Accountabilities:  

Data Architecture & Pipeline Development: Design, build, and manage advanced data solutions, including data lakes and databases.  Generative AI Implementation: Utilise generative algorithms to produce synthetic data, creating realistic simulations for training and validation purposes.  Data Governance: Ensure data quality and data governance standards are upheld through careful design and documentation. Ensure that the data pipelines and databases align with the Deloitte security protocols and industry standards.  Team Collaboration: Partner with various stakeholders to identify business requirements and translate them into data solutions.  Technical Leadership: Provide technical mentorship to junior team members and advise on best practices and technologies in the data engineering domain.  Innovation and Research: Evaluate emerging technologies and methodologies in data engineering and Generative AI to ensure the organisation remains at the forefront of the industry.  AI Enablement: Practical experience in building pipelines that enable AI / ML technologies.  Data Governance: Understanding of data quality, data lineage, and data governance principles. Communication Skills: Ability to convey complex information in an accessible manner to both technical and non-technical stakeholders. 

Enough about us, let’s talk about you.

A minimum of 5 years professional experience in Data Engineering, preferably with a focus on Generative AI Bachelor's or Master’s degree in Computer Science, Engineering, Mathematics, or a related field is preferrable Experience with platform and software development, release management in a mature managed services environment  Cloud technologies and platforms such as Azure or Amazon AWS  UNIX/Linux deployment and configuration management  TCP/IP networking, databases, messaging and security  Knowledge of and experience with DevOps tools and techniques, such as Infrastructure as Code and Immutable Infrastructure  Experience with CI tools such as Jenkins, Hudson, Bamboo, Thoughtworks Go  Security protocols such as OAuth, SAML or OpenID Connect  Must have an ability to effectively communicate and work with people with a diverse range of skills and experience

  • Melbourne, Australia Avanade Full time

    Intelligent Data Platform - Data Engineering ManagerLeading organisations – corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interesting work that is well supported, always evolving and sure to keep you engaged and...


  • Melbourne, Australia Amazon Web Services Australia Pty Ltd - D81 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....


  • Melbourne, Australia Amazon Full time

    DESCRIPTIONAWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to...


  • Melbourne, Australia Australian Super Full time

    Flexible and inclusive work environment Full-time, permanent opportunity  Deliver outcomes for our Members At AustralianSuper, we truly care about our colleagues.​ We know work and life are intertwined. That’s why we support the diverse needs of everyone and have policies that enable us all to thrive and be truly flexible. We ensure diversity is...


  • Melbourne, Australia Microsoft Full time

    OverviewWhy MicrosoftMicrosoft is a company where passionate innovators come to collaborate, envision what can be and take their careers to levels they cannot achieve anywhere else. This is a world of more possibilities, more innovation, more openness, and sky's-the-limit thinking -- a cloud-enabled world.The purpose of the roleThe Data and Artificial...


  • Melbourne, Australia Microsoft Full time

    Overview Why Microsoft Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers to levels they cannot achieve anywhere else. This is a world of more possibilities, more innovation, more openness, and sky's-the-limit thinking -- a cloud-enabled world. The purpose of the role The Data and...


  • Melbourne, Australia INAUTALENT Full time

    About Our Client:Our client is a sports technology company specialising in Generative AI and VR/AR technologies, dedicated to transforming the sports and entertainment industry with unparalleled digital experiences. Their mission is to leverage the latest advancements in AI to create immersive, interactive content that sets new standards for engagement and...


  • Melbourne, Australia Data Science Group Full time

    As a Data Science and Analytics Consultant, you will work with clients to design their AI processes and governance procedures, develop innovative solutions to complex business challenges, provide strategic guidance on leveraging data to drive business outcomes, and design and implement data-driven solutions. You will be responsible for delivering successful...


  • Melbourne, Australia Microsoft Full time

    **Why Microsoft** Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers to levels they cannot achieve anywhere else. This is a world of more possibilities, more innovation, more openness, and sky's-the-limit thinking - a cloud-enabled world. **The purpose of the role** **Responsibilities**: The...


  • Melbourne, Australia Avanade Full time

    Intelligent Data Platform - Data Engineering ManagerLeading organisations – corporations, non-profits, government departments, look to Avanade to help them make the most of their investment in Microsoft and to push the boundaries of digital innovation. The result? Interesting work that is well supported, always evolving and sure to keep you engaged and...


  • Melbourne, Australia NTT DATA Full time

    Job Description NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network...


  • Melbourne, Australia CitiPower and Powercor Full time

    About the Role: We are excited to offer this opportunity for a highly analytical and motivated Machine Learning Engineer to join our team in a permanent capacity. This role plays a critical role in applying skills and expertise in the Digital Innovation R&D team for the building of AI-based applications, machine learning models, and associated tools...


  • Melbourne, Australia CitiPower Powercor Full time

    About the Role: We are excited to offer this opportunity for a highly analytical and motivated Machine Learning Engineer to join our team in a permanent capacity. This role plays a critical role in applying skills and expertise in the Digital Innovation R&D team for the building of AI-based applications, machine learning models, and associated tools and...

  • Chief of Staff

    4 weeks ago


    Melbourne, Australia StrongRoom AI Full time

    **About StrongRoom AI** StrongRoom AI is an exciting, dynamic and young venture-backed company. We are an AI-driven start-up within the healthcare industry working on a management platform aimed at reducing adverse drug events within the Pharmacy, Hospital and Aged Care Facility settings. We specialise in AI analytics and Facial Recognition technology for...


  • Melbourne, Australia Microsoft Full time

    OverviewDo you enjoy solving problems, looking at problems through a different lens, and working closely with customers to innovate new solutions to complex problems? Do you jump with excitement at the opportunity to identify trends and provide unique business solutions? Do you want to join a team where learning about a new technology or solution is part of...

  • Senior Data Engineer

    2 weeks ago


    Melbourne, Australia Vanguard Full time

    More than 45 years ago, John C. Bogle had a vision to start an investment company that did things differently. A company with no external shareholders. Where all the profits were invested back into the business and used to lower costs. Evidently, it was as bold as it was brilliant. To this day, Vanguard Group still has no external shareholders. That means no...

  • Senior Data Engineer

    2 weeks ago


    Melbourne, Australia Vanguard Full time

    More than 45 years ago, John C. Bogle had a vision to start an investment company that did things differently. A company with no external shareholders. Where all the profits were invested back into the business and used to lower costs. Evidently, it was as bold as it was brilliant. To this day, Vanguard Group still has no external shareholders. That means no...

  • Data Bricks

    4 weeks ago


    Melbourne, Australia Pyramid Global Technologies Full time

    About the job Data Bricks - Solution Designer "Tech Stack Required:Required: 12+ Years· Experience in Data Lake, Azure Data Bricks· Experience Designing and deploying Databricks platforms for any of AWS, Azure or Google Cloud· Experience building and deploying data engineering pipelines into production, including...

  • Senior Data Engineer

    3 weeks ago


    Melbourne, Victoria, Australia Vanguard Full time

    More than 45 years ago, John C. Bogle had a vision to start an investment company that did things differently. A company with no external shareholders. Where all the profits were invested back into the business and used to lower costs. Evidently, it was as bold as it was brilliant. To this day, Vanguard Group still has no external shareholders. That means no...

  • Data Engineer

    1 week ago


    Port Melbourne, Australia Vero Insurance Full time

    Jobs - Job Details - Data Engineer Careers at Suncorp Take the next step. Be part of something bigger at Suncorp. Data Engineer Job No: 671180 Sydney - Inner Suburbs & CBD, Brisbane - Inner Suburbs & CBD, Melbourne - Inner Suburbs & CBD, Various Max Term Full Time Human Resources & Training, IT Pay Band 4 Full-time 12-month contract Flexible working...