Enterprise Data Pipeline Architect

3 days ago


Sydney, New South Wales, Australia desda pty Full time

Enterprise Data Pipeline Architect

About the Role

We are seeking an experienced Enterprise Data Pipeline Architect to join our team. In this role, you will be responsible for designing, developing, and optimizing ETL pipelines for data migration and transformation across multiple enterprise systems. You will also work closely with our technical teams to deliver high-quality data solutions that meet our business needs.

Responsibilities
  • Design and develop ETL pipelines using Informatica, Databricks, and other ETL tools.
  • Work closely with technical teams to deliver high-quality data solutions.
  • Collaborate with business stakeholders to understand their requirements and translate them into efficient ETL solutions.
  • Ensure data quality and consistency by developing robust reconciliation frameworks.
  • Troubleshoot ETL processes and optimize performance.
Requirements
  • Strong architecture and design skills.
  • Strong SQL development skills and experience with ETL tools.
  • Superannuation domain expertise is essential, with Superannuation registry experience preferred.
  • Experience in data reconciliation and validation frameworks.
  • Hands-on experience in data migration projects.
  • Strong analytical and problem-solving skills.
  • Excellent communication skills.


  • Sydney, New South Wales, Australia Salt Full time

    We're seeking an experienced Enterprise Data Solutions Architect to join our team at Salt. In this role, you'll contribute to building the best technology business in financial services by designing, developing, and deploying enterprise-scale data solutions.Responsibilities:Designing and implementing data lakes and warehouses on GCP using BigQuery, Dataflow,...


  • Sydney, New South Wales, Australia PayTech Nexus Ltd Full time

    About the CompanyWe are PayTech Nexus Ltd, a leading provider of innovative payment solutions.About the Role:This is a 12-month contract opportunity with an ASAP start date.The role is based in Sydney, with a hybrid work arrangement.You will have the opportunity to work with one of the largest and most advanced Data Engineering teams in the...


  • Sydney, New South Wales, Australia MAP TALENT Full time

    About the PositionWe are seeking an experienced Enterprise Data Architect to join our team at MAP TALENT. The successful candidate will have a strong background in creating and maintaining conceptual, logical and physical data models.ResponsibilitiesData ArchitectureLead and moderate focus groups and individual meetings with business, project, data and...


  • Sydney, New South Wales, Australia Resource Corner Full time

    As a Senior Solutions Designer at Resource Corner, you will play a crucial role in building data solutions aligned to our federated data platform architecture. We are looking for an expert with strong ETL design experience in AWS and a good understanding of traditional & modern data architecture.The ideal candidate will have experience in designing complex...

  • Data Architect

    3 weeks ago


    Sydney, New South Wales, Australia XPERT CONSULTING PTY LTD Full time

    Xpert Consulting Pty Ltd (trading as Novon) is a large Sydney based IT Services business. We operate a number of Technology centric brands including Novon , our IT Services business focused on delivering Data Transformation Services for clients large and small.Do you like to design strategic data solutions for complex enterprise environments? We have several...


  • Sydney, New South Wales, Australia Paxus Full time

    We are seeking a highly skilled Lead Engineer - Big Data to join our team and work on a cutting-edge data platform. As a key member of our team, you will be responsible for designing and developing scalable data solutions, implementing modern data architectures, and leading data projects in a complex enterprise environment.About the TeamOur team is comprised...

  • Data Architect

    4 days ago


    Sydney, New South Wales, Australia Zone IT Solutions Full time

    We are looking for a talented Data Architect to join our team at Zone IT Solutions. As a global consulting firm, we're seeking an expert in Big Data platforms, specifically Cloudera Hadoop.Key responsibilities:Design and implement efficient data pipelines using MapReduce, PySpark, Kafka, Sqoop, Impala, Hive, and other tools in the Hadoop ecosystem.Develop...

  • Data Architect

    2 days ago


    Sydney, New South Wales, Australia Capgemini Full time

    This is a Data Architect role with one of the leading companies in AU right now -- Capgemini -- with an amazing team. They are continuing to grow rapidly. This is the chance to join right as the takes off.More About the Role at Capgemini **The focus of your role:** We are seeking a Data Architect (Manager) to lead and drive data architecture project...


  • Sydney, New South Wales, Australia Culture Amp Full time

    Culture Amp is a global leader in employee experience platforms, enabling companies to create a better world of work by transforming employee engagement, driving performance management, and developing high-performing teams.We are seeking a highly skilled Data Engineer to join our Data Platform team, which is responsible for supporting and improving Culture...


  • Sydney, New South Wales, Australia HSO Enterprise Solutions GmbH Full time

    The role of Pre-Sales Architect at HSO Enterprise Solutions GmbH is that of a senior expert providing strategic guidance through consulting engagements.Key responsibilities include:Developing solutions to meet customer requirements using best-of-breed technologies and methodologies.Translating business requirements into technology requirements for inclusion...


  • Sydney, New South Wales, Australia Big Red Group Full time

    Key Responsibilities- Architect and build scalable data pipelines: Design and implement efficient data workflows, ensuring data is readily available for analysis.- Integrate diverse data sources: Work with a variety of systems and datasets, bringing together information from across the business.- Ensure data quality and reliability: Implement data governance...


  • Sydney, New South Wales, Australia Dynamo Recruitment Full time

    Job DescriptionAs a Senior Enterprise Solution Architect at Dynamo Recruitment, you will lead the solution architecture design, application development and support of enterprise applications. This includes managing and maintaining application platforms to ensure they are current, efficient and effective.Main ResponsibilitiesManage technical deliverables in...


  • Sydney, New South Wales, Australia Boston Consulting Group Full time

    What We DoWe help clients navigate the complexities of digital transformation, leveraging our expertise in technology strategy, architecture, and implementation. Our consultants work closely with clients to assess their current state, define target states, and develop tailored transition roadmaps.Our ApproachWe take a hypothesis-driven approach to...


  • Sydney, New South Wales, Australia Datacom Full time

    SOE ArchitectAre you passionate about shaping the future of endpoint environments? As an Endpoint Architect, you'll have the unique opportunity to design, implement, and optimise endpoint solutions that protect an organisation's most valuable assets—its data and people.About Datacom:Datacom works with organisations and communities across Australia and New...


  • Sydney, New South Wales, Australia Macquarie Bank Limited Full time

    We're excited to bring on board a Senior Data Architect to join our Exposure Identification team in the Vulnerability Management service within Cybersecurity.This role offers the unique opportunity to contribute to the design, development and maintenance of a modern data pipeline, shaping the future of our vulnerability management platform.As a Senior Data...


  • Sydney, New South Wales, Australia The Hustle Full time

    Enterprise Solutions Architect Role SummaryThe Hustle is a dynamic company that empowers thousands of businesses worldwide to grow better. We are seeking an experienced Enterprise Solutions Architect to join our global Presales organisation at HubSpot.In this role, you will work closely with cross-functional teams and contribute to a supportive,...

  • Data Architect Lead

    2 days ago


    Sydney, New South Wales, Australia Kirra Services Full time

    At Kirra Services, we are seeking a highly skilled Data Architect Lead to join our team.Job DescriptionThe Data Architect Lead will be responsible for developing, testing, and supporting end-to-end data integration/ETL solutions in cloud and on-premise environments. This includes designing, implementing, and maintaining data pipelines, as well as...


  • Sydney, New South Wales, Australia PayTech Group Full time

    Job SummaryWe are seeking an experienced Senior Data Engineer to join our team at PayTech Group. In this role, you will design and build data platforms and data pipeline solutions across the bank, leveraging your expertise in software development/programming and data-driven solutions.Key responsibilities include:Designing and building enterprise-wide data...


  • Sydney, New South Wales, Australia Optiver US LLC Full time

    About OptiverOptiver is a global market maker founded in Amsterdam, with offices around the world. Established in 1986, we are a leading liquidity provider, with close to 2,000 employees united in our commitment to improve the market through competitive pricing, execution and risk management.We provide liquidity to financial markets using our own capital, at...


  • Sydney, New South Wales, Australia Tideri Jobbörse Full time

    Job OverviewWe are looking for an experienced Azure Data Solutions Architect to lead our cloud engineering efforts. The ideal candidate will have expertise in Azure Data Lake, Databricks, Azure Data Factory (ADF), and Azure Synapse Analytics.Key Responsibilities:Design and implement data migration strategies from AWS to AzureDevelop and optimize data...