Senior Data Engineer

2 weeks ago


Sydney, Australia KAPiTAL Consulting Full time
  • Tech consulting working on Banking clients
  • Open to Sydney based candidates
  • Synapse and Purview experience required

Global IT consultancy is looking for Senior Data Engineers to join their team in working on their banking and financial services clients. With a focus on leveraging cutting-edge technologies, they deliver tailored solutions to address their clients' unique challenges and drive their digital transformation journey forward. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing Azure-based data solutions while collaborating closely with various technical teams to ensure the successful delivery of projects.

Key Responsibilities: 

  • Design, develop, and implement Azure solutions leveraging Azure Synapse, Purview, Spark (Python and Scala), and PowerBI 
  • Utilise programming languages such as Python or Scala to create robust data products and demonstrate proficiency in data mesh concepts.
  • Possess expertise in Linux scripting and PowerShell, with a strong understanding of source version control using tools like Bitbucket, Git, Jenkins, and DevSecOps.
  • Identify existing gaps at customer locations and provide scalable solutions across various Azure services.
  • Translate business requirements into technical specifications aligned with customer architecture and initiatives.
  • Develop documentation including Software Technical Solution (STS), Detail Design Approach (DDA), Impact Analysis, Detailed Technical Design (DTD), and Interface Specifications.
  • Estimate project efforts, perform project planning, and conduct Impact Analysis on downstream applications.
  • Conduct unit testing, diagnose, and correct errors and faults according to established guidelines and quality standards.
  • Provide software development support for production implementation and warranty defect fixes.
  • Review code to ensure coding and quality standards are met, and actively participate in Agile ceremonies such as Daily Scrum Stand-ups, Sprint Planning, PI Planning, Demos, and Retrospectives.

Requirements:

  • Minimum 5 years experience in Data Engineering
  • Extensive experience in creating Azure solutions and enabling Azure capabilities.
  • Hands-on experience with Synapse, Purview ADLS2, Spark (Python and Scala), and Cosmos DB.
  • Proficiency in either Python or Scala programming languages.
  • Strong understanding of Linux scripting and PowerShell.
  • Knowledge of source version control using Bitbucket, Git, Jenkins, and DevSecOps.
  • Ability to translate business requirements into technical specifications.
  • Excellent communication and interpersonal skills, with the ability to collaborate effectively across technical teams.
  • Proven experience in Agile methodologies and Agile ceremonies.
  • Strong analytical and problem-solving skills.
  • Ability to mentor team members and resolve conflicts effectively.


  • North Sydney, Australia NTT DATA Full time

    NTT DATA is heavily investing globally in providing state of the art analytical solutions to its clients. Our capability has been focused locally, regionally in APAC and globally by forming strategic partnerships including Microsoft Azure, SAP Analytics, Snowflake, Matillion and many more, leveraging the strength of our cloud and network assets via the NTT...

  • Senior Data Engineer

    23 hours ago


    Sydney, Australia Talenza Full time

    Senior Data Engineer Sydney, Australia 6 Months (Intially) $970pd Inc Super We are seeking a highly skilled and experienced Azure Senior Data Engineer to join a leading insurance business based in Sydney. As an Azure Senior Data Engineer, you will play a critical role in designing and building ETL processes for their data...

  • Senior Data Engineer

    1 month ago


    Sydney, Australia Pyramid Global Technologies Full time

    About the job Senior Data Engineer Job Description: Sr. Data Engineer *Power BI,*Tableau,*SQL advanced,*Data warehousing concepts, and everything related to data

  • Senior Data Engineer

    2 months ago


    Sydney, Australia Woolworths Group Limited Full time

    Senior Data Engineer Work in a progressive, industry leading environment An exciting and inclusive culture of growth and innovation Sydney based with Surry Hills office location with WFH flexibility About Cartology Cartology is the Woolworths Group's stand alone media business and the exclusive media partner to Woolworths Supermarkets....


  • Sydney, Australia Vero Insurance Full time

    Jobs - Job Details - Senior Data Engineer Careers at Suncorp Take the next step. Be part of something bigger at Suncorp. Senior Data Engineer Job No: 671600 Sydney - Inner Suburbs & CBD, Brisbane - Inner Suburbs & CBD, Melbourne - Inner Suburbs & CBD, Various Permanent Full Time IT Pay Band 5 Drive the technical vision for implementing new cloud data...


  • Sydney, Australia Vero Insurance Full time

    Jobs - Job Details - Senior Data Engineer Careers at Suncorp Take the next step. Be part of something bigger at Suncorp. Senior Data Engineer Job No: 671600 Sydney - Inner Suburbs & CBD, Brisbane - Inner Suburbs & CBD, Melbourne - Inner Suburbs & CBD, Various Permanent Full Time IT Pay Band 5 Drive the technical vision for implementing new cloud data...

  • Senior Data Engineer

    1 month ago


    Sydney, Australia West Recruitment Full time

    - Not for profit- Excellent benefits- Flexible workingSenior Data Engineer required for our not for profit, Sydney based client.Key Responsibilities:This role will take responsibility for the following areas;•Leveraging Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage to build end-to-end...

  • Senior Data Engineer

    2 months ago


    Sydney, Australia Virtusa Full time

    Senior Data Engineer - CREQ183850 Description ETL Dev and Testing Teradata Scala Python SQL Selenium Test automation Datawarehousing / BI experience Spark Hadoop / Big Data / HDFS Cloud migration experience AWS Cloud experience Primary Location Sydney, New South Wales, Australia Job Type Experienced Primary Skills Snowflake...


  • Sydney, Australia Suncorp Group Full time

    Drive the technical vision for implementing new cloud data platform on Databricks to support Data Warehousing, Data Science and Gen AI use cases Experience implementing Databricks along with defining patterns and frameworks Empower and guide a high performing, collaborative team We’re never just satisfied with how things are – because we know how...

  • Senior Data Engineer

    4 weeks ago


    Sydney, Australia Northbridge Recruitment Full time

    Are you passionate about protecting Customer rights , building better trader behaviour and driving a fair marketplace, and creating an inclusive culture for the people of NSW? Are you ready to pioneer a new function that merges intelligence and data analytics to drive real change in a regulatory environment?We  are looking for a Senior Data Engineer who...


  • Sydney, Australia Quantexa Full time

    What we’re all about.It isn’t often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. We’re a...


  • Sydney, Australia Tinybeans Full time

    Tinybeans is a leading private photo-sharing app that connects families and turns moments into memories. We’re loved and trusted by millions of parents and families around the world since our founding in 2012, which is why we’ve got more than 150,000 5-star reviews in the Apple App and Google Play stores and users in almost every country in the world....


  • Sydney, Australia ING Bank (Australia) Limited Full time

    Data is one of the five building blocks of ING’s “Accelerated Think Forward” strategy and COO vision to become the Next Generation Digital Bank on the road of transformation.As a Senior Data Engineer, you will be responsible for designing and implementing data ingestion pipelines from multiple sources using Azure Synapse. Developing scalable and...

  • Senior Data Engineer

    4 weeks ago


    Sydney, Australia Technology People Australia Full time

    We are seeking highly skilled and motivated Data Engineers to join our client who are in financial domain. As a Data Engineer, you will play a critical role in designing, implementing, and maintaining their data infrastructure. Your expertise in Snowflake, Redshift, AWS, CloudFormation, Python, and SQL will be instrumental in shaping their data...


  • Sydney, New South Wales, Australia Randstad Australia Full time

    About the companyMy client is a leading global multinational investment bank and financial services company. They are working to create lasting value for our communities, our clients and our people. It is headquartered and listed in the Australian stock exchange and employs nearly 15000 staff in over 20 countries, is the world's largest asset manager in...


  • Sydney, Australia Randstad Australia Full time

    About the companyMy client is a leading global multinational investment bank and financial services company. They are working to create lasting value for our communities, our clients and our people. It is headquartered and listed in the Australian stock exchange and employs nearly 15000 staff in over 20 countries, is the world's largest asset manager in...


  • Sydney, Australia Simple Machines Full time

    Position: Senior Data Platforms EngineerLocation: Sydney, AustraliaTravel: Potential travel within the ANZ region on occasionSimple Machines. Data Engineered to Life™ Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating...


  • Sydney, Australia Echo Entertainment Group Full time

    At The Star Entertainment Group, we aim to be Australia’s leading integrated resort company. Our mission is to create fun and memorable experiences for the millions of guests we welcome each year at our trusted destinations. Our properties across Sydney, Brisbane, and the Gold Coast are world-class with many award-winning hotels, restaurants, bars, and...


  • Sydney, Australia Industrial Light & Magic Full time

    Résumé du poste: Your role? Core Pipeline is a globally distributed team that develops tools and workflows that act as the foundational infrastructure for ILM’s creative departments at all of our locations around the world. We work closely with CG Production to create innovative tooling for media management, publishing and asset management,...


  • Sydney, Australia Industrial Light & Magic Full time

    Job Summary: Your role? Core Pipeline is a globally distributed team that develops tools and workflows that act as the foundational infrastructure for ILM’s creative departments at all of our locations around the world. We work closely with CG Production to create innovative tooling for media management, publishing and asset management, developer...