Cloud Data Engineering Expert

2 weeks ago

Sydney, New South Wales, Australia One51 Consulting Full time

One51 Consulting seeks a Cloud Data Engineering Expert who will be responsible for developing and maintaining data architecture, data models, and standards for various data integration and data warehouse projects in Azure. This role involves designing and implementing ETL pipelines in and out of a data warehouse using Azure Data Factory (ADF), ensuring new features and subject areas are modelled to integrate with existing structures and provide a consistent view.

Key Responsibilities:

  • Design and Develop ETL Pipelines: Design and develop ETL pipelines in and out of a data warehouse using Azure Data Factory (ADF).
  • SQL Query Development: Ability to write SQL queries against Azure SQL Database / Synapse.
  • Production Support: Provide production support for Azure SQL Database / Synapse issues such as data load problems, transformation, and translation problems.
  • Integration: Integration of on-premises infrastructure with cloud (Microsoft Azure) infrastructure.
  • Data Modelling and Design: Effectively translate requirements for Business Intelligence, Reporting, and Analytics to database modelling and design.
  • Data Pipeline Automation: Ability to understand data pipelines and modern ways of automating data pipelines using cloud-based and on-premises technologies.
  • Implementation and Documentation: Actively test and document implementations, so others can easily understand the requirements, implementation, and test conditions.
  • Collaboration: Partner with the Data Architects, Product Managers, and Scrum Masters to deliver data integrations solutions required for various projects.
  • Documentation: Ensure effective technical and project documentation across all phases of delivery.

Requirements:

  • Comprehensive Experience: Comprehensive, hands-on experience working as a Microsoft Azure Data Engineer. Ideally, a minimum of 3 years in Data Warehousing, ETL/ELT, BI, and Analytics projects.
  • End-to-End Implementation: Must have experience with at least one (1) end-to-end implementation of an Azure Cloud Data Warehouse and two (2) end-to-end data warehouse implementations.
  • Data Modelling and ELT: Expertise in data modelling, ELT using ADF, implementing complex views, stored procedures, and standard DWH and ETL/ELT concepts.
  • Azure Cloud Experience: Extensive design and implementation experience in Azure cloud data platform and modern data warehousing. Including aspects such as Security, Azure Logging and Monitoring, Azure Databricks, Synapse, Azure Blob Storage, Azure Data Lake, Azure Data Factory, Azure SQL Database, Azure Analysis Services, Power BI.
  • Relational and NoSQL Data Stores: Deep understanding of relational and NoSQL data stores, methods, and approaches (star and snowflake, dimensional modelling).
  • Data Security and Access Controls: Experience with data security and data access controls and design.
  • RDBMS and Complex SQL Queries: Proficiency in RDBMS, complex SQL queries, database performance tuning, and troubleshooting.
  • Full-Stack MS Power BI Modelling: Commercial experience with full-stack MS Power BI modelling (M code), Dax, data storytelling, report publishing, security, and knowledge of how people make decisions with data.
  • Agile Development Methodologies: Must have experience with Agile development methodologies.
  • Communication Skills: Strong written communication skills. Is effective and persuasive in both written and oral communication.

About One51 Consulting

At One51 Consulting, we value creativity, curiosity, and trust. We believe in the positive impact data and analytics can have in the data-driven organisation and individual. Our culture is built on these core values, which guide our work and interactions.

Benefits

We offer a competitive salary range of AU$120,000 - AU$180,000 per annum, depending on experience. Additionally, you'll enjoy a hybrid working arrangement – primarily working from home, with optional office days scheduled 1-2 days per week at our Sydney office. At One51 Consulting, you'll have the opportunity to work with companies in different business sectors in a relaxed and supportive environment.

  • Data Engineer: Cloud Data Solutions Expert

    3 weeks ago

    Sydney, New South Wales, Australia Neilson Financial Services Full time

    Job Title: Data Engineer: Cloud Data Solutions Expert We are seeking a skilled Data Engineer to join our team at Neilson Financial Services. This role will involve designing, building, and maintaining cloud-based data solutions using Azure services such as Azure Data Factory, Azure SQL Database, and Power BI. About the Role:Design, develop, and maintain...

  • Cloud Data Solutions Expert

    2 weeks ago

    Sydney, New South Wales, Australia Databricks Full time

    At Databricks, we're seeking a seasoned Cloud Data Solutions Expert to join our team. As a key member of our pre-sales engineering team, you will play a vital role in guiding the technical evaluation phase of our sales process.You'll work closely with our sales teams to provide expert advice on the design and implementation of data architectures within...

  • Cloud Data Expert

    3 weeks ago

    Sydney, New South Wales, Australia Cloudera Full time

    Job DescriptionWe are seeking a highly skilled Cloud Data Expert to join our team at Cloudera. As a critical member of our sales team, you will be responsible for promoting and selling Cloudera Data Platform (CDP) - Public Cloud.About the RoleThe successful candidate will have a deep understanding of cloud technology, sales execution, and the ability to...

  • Expert Cloud Data Architect

    3 weeks ago

    Sydney, New South Wales, Australia Whizdom Recruitment Full time

    About the RoleThis 2-3 year contract role offers a hybrid working arrangement located in Sydney. As an Expert Cloud Data Architect, you will be responsible for designing and engineering complex data solutions with advanced transformation and data quality analysis experience.You will lead full solution development, providing technical leadership and...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Data - AI & Data Science Full time

    Drive Business Value with Data Engineering at Domain GroupWe are seeking a skilled Data Engineer to join our Data Decision Science team in Sydney. As a key member of our data department, you will play a critical role in building scalable data pipelines that power Australia's property market.About the RoleThis is an exciting opportunity to work with...

  • Cloud Data Engineering Leader

    1 week ago

    Sydney, New South Wales, Australia Databricks Full time

    We are seeking a highly skilled Cloud Data Engineering Leader to join our team at Databricks.About the RoleAs a Cloud Data Engineering Leader, you will be responsible for guiding the technical evaluation phase in a hands-on environment throughout the sales process. You will work closely with our product team as an advocate for your customers in the field and...

  • Cloud Data Engineer for Marketing Analytics

    2 weeks ago

    Sydney, New South Wales, Australia GroupM Full time

    About UsGroupM is a leading data and technology consulting firm that empowers clients to drive media effectiveness. Our team of experts delivers innovative solutions that leverage the power of data, analytics, and technology.Job DescriptionWe are seeking a skilled Google Cloud Platform Data Engineer to join our rapidly growing team. As a key member of our...

  • Data Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Talent Insights Full time

    About Talent InsightsTalent Insights is a leading provider of data-driven solutions, empowering businesses to make informed decisions. We are seeking an experienced Data Engineer with expertise in AI and cloud technologies to join our team.Job OverviewThis exciting opportunity involves building and optimizing data pipelines using the latest tools and...

  • Data Engineering Cloud Architect

    3 weeks ago

    Sydney, New South Wales, Australia Databricks Full time

    About This RoleWhile candidates in a specific location are encouraged for this role, we welcome remote candidates from other locations. This is a full-time position.As a Pre-sales Data Engineering Cloud Architect, you will lead the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor to the sales...

  • Cloud Engineering Expert

    3 weeks ago

    Sydney, New South Wales, Australia NCS Australia Full time

    Job OverviewNCS Australia is seeking a skilled Cloud Engineering Expert to join our team. In this role, you will have the opportunity to work on designing, building, and maintaining infrastructure as code and applications built on Google Cloud.About the RoleAs a Cloud Engineering Expert at NCS Australia, your responsibilities will include designing,...

  • Data Engineering Cloud Architect

    2 weeks ago

    Sydney, New South Wales, Australia Databricks Full time

    At Databricks, we're looking for a highly skilled Pre-sales Sr. Solutions Architect to join our team. This is a full-time position that requires extensive experience in data engineering and cloud architecture.This role involves guiding the technical evaluation phase in a hands-on environment throughout the sales process. You'll work closely with the sales...

  • Data Engineering Expert

    3 weeks ago

    Sydney, New South Wales, Australia Whizdom Recruitment Full time

    Role OverviewWe are seeking an experienced Data Engineer to lead our Enterprise Data Warehousing project in Sydney. This is a unique opportunity to work with a prestigious multinational consultancy and contribute to the success of a Big 4 Bank end client.About the RoleThe EDW Lead Engineer will be responsible for developing, testing, supporting, and...

  • Data Engineering Cloud Architect Lead

    2 weeks ago

    Sydney, New South Wales, Australia Databricks Full time

    Data Engineering Cloud Architect LeadWe offer a highly competitive salary in the range of $120,000 - $180,000 per year.About the Role:As a Pre-sales Solutions Architect (Analytics, AI, Big Data, Public Cloud) at Databricks, you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor...

  • Cloud Data Automation Expert

    3 weeks ago

    Sydney, New South Wales, Australia REO Group Full time

    Job TitleData Engineer Position Available at REO GroupJob SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team at the REO Group. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining scalable data solutions using the Azure data stack.Key ResponsibilitiesDesign and...

  • Cloud Data Integration Expert

    1 month ago

    Sydney, New South Wales, Australia dentsu Full time

    Job Title: Cloud Data Integration ExpertAbout Us:dentsu is a network designed for what's next, helping clients predict and plan for disruptive future opportunities and create new paths to growth in the sustainable economy through five global leadership brands.About the Role:As a Cloud Data Integration Expert, you will be responsible for designing and...

  • Cloud Data Platform Engineer

    3 weeks ago

    Sydney, New South Wales, Australia Canva Full time

    Cloud Data Platform EngineerWe're seeking a skilled Cloud Data Platform Engineer to join our team at Canva. As a key member of our Data Platform Group, you'll play a crucial role in designing and implementing a scalable data infrastructure management framework for our cloud-based data platform.About the RoleThis is an exciting opportunity to work on a...

  • Lead Cloud Data Architect in Sydney

    4 weeks ago

    Sydney, New South Wales, Australia Data Privacy Full time

    Job DescriptionTalented cloud data architects wanted to join our team at Data Privacy. This role is perfect for someone with expertise in AWS, S3, and cloud data platforms.About the RoleThis technical lead position involves leading the development of a new data warehouse platform, providing guidance to developers, reviewing data designs and models, and...

  • Data Pipeline Specialist

    2 weeks ago

    Sydney, New South Wales, Australia Hydrogen Group Full time

    About Hydrogen GroupWe are a leading financial organisation, committed to delivering excellence in our projects. As we continue to grow and expand, we are seeking highly skilled Data Engineers to join our team.Role OverviewThis is an exciting opportunity for a Data Engineer to work on cutting-edge ETL design and Big Data projects with a focus on AWS. The...

  • Cloud Data Engineering Leader

    3 weeks ago

    Sydney, New South Wales, Australia Databricks Full time

    Job Title: Cloud Data Engineering LeaderWe are seeking an experienced Cloud Data Engineering Leader to join our team at Databricks. As a key member of our pre-sales organization, you will play a critical role in guiding customers through the evaluation and adoption of our Data Intelligence Platform.

  • Cloud Migration Data Engineer

    1 week ago

    Sydney, New South Wales, Australia REO Group Full time

    Role OverviewWe are seeking a highly motivated and results-oriented Data Engineer to join our team in Sydney, NSW.This pivotal role will involve driving cloud migration and data automation initiatives, with a focus on transitioning data platforms to the cloud while improving efficiency and innovation.In the first 12 months, you will deliver critical data...