Real-Time Data Architect

7 days ago

Sydney, New South Wales, Australia beBeeDataEngineering Full time
Principal Data Engineer

We are seeking a seasoned Principal Data Engineer to join our team. This is a hands-on role focused on building real-time data pipelines and implementing data mesh architectures to enhance client data interactions.

The ideal candidate will have deep technical expertise in modern data engineering methods, as well as excellent consulting skills and experience in working with clients to understand their needs and develop tailored solutions.

Key Responsibilities:
  • Design and architect scalable data solutions using Databricks Lakehouse Architecture and best practices around Delta Lake, data modeling, and distributed processing.
  • Develop and enhance data-driven solutions integrating with clients' systems using state-of-the-art tools such as Databricks, Snowflake, Google Cloud, and AWS.
  • Develop and optimise high-performance, batch and real-time data pipelines employing advanced streaming technologies like Kafka and Flink.
  • Optimise and manage a broad array of database technologies, from traditional relational databases (e.g., PostgreSQL, MySQL) to modern NoSQL solutions (e.g., MongoDB, Cassandra).
  • Utilise big data frameworks such as Apache Spark and Apache Flink to address challenges associated with large-scale data processing and analysis.
  • Implement and oversee cloud-specific data services including AWS Redshift, S3, Google BigQuery, and Google Cloud Storage.
Requirements:
  • At least 8+ years of data engineering or equivalent experience in a commercial, enterprise, or start-up environment.
  • Hands-on experience in Databricks to help us build scalable, high-performance data solutions.
  • Demonstrates proficiency in SQL and Spark, and familiarity with platforms such as Databricks and Snowflake.
  • Knowledgeable in data warehousing technologies like BigQuery, Snowflake, and Databricks.
Benefits:

This is an exciting opportunity to work with a talented team of engineers and technologists who are passionate about unlocking the potential of data. You will have the chance to develop your skills and expertise, work on challenging projects, and contribute to the growth and success of our organisation.

Our team is committed to creating a collaborative and inclusive work environment that supports the well-being and career development of all employees. We offer competitive salaries, flexible working arrangements, and opportunities for professional growth and advancement.

What We Offer:

Our company offers a dynamic and supportive work environment that allows you to grow and develop your skills and expertise. We are committed to fostering a culture of innovation, collaboration, and mutual respect, where everyone feels valued and empowered to contribute.

Our team is passionate about making a positive impact through technology, and we are dedicated to creating solutions that drive business value and improve people's lives.

How to Apply:

If you are a motivated and experienced data engineer looking for a new challenge, please submit your application, including your resume and a cover letter outlining your relevant skills and experience.

We thank all applicants for their interest; however, only those selected for an interview will be contacted.

  • Real-Time Data Architect

    2 days ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $160,000 - $200,000

    Job Overview:The role of Senior Data Operations Engineer involves designing, building, and maintaining scalable and robust data platforms for Integration Platform teams.You will be responsible for developing real-time data streaming, distribution, and secure file transfer platforms using Confluent Platform and CrushFTP.This is a hands-on engineering and...

  • Data Architect

    4 days ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    OverviewDrive long-term value and innovation through data-led transformationBe involved in key transformation projectsMake Your Mark – Newly Created PositionAbout usEstablished in 2007, CDC Data Centresis Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW,...

  • Data Architect

    4 days ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    OverviewDrive long-term value and innovation through data-led transformation Be involved in key transformation projects Make Your Mark – Newly Created Position About us Established in 2007, CDC Data Centresis Australia's leading operator of sovereign, secure, world-class data centre facilities. Headquartered in Canberra with multiple...

  • Data Architect

    7 days ago

    Sydney, New South Wales, Australia CDC Data Centres Full time $90,000 - $120,000 per year

    Drive long-term value and innovation through data-led transformation Be involved in key transformation projects Make Your Mark – Newly Created Position About us:Established in 2007, CDC Data Centres is Australia's leading operator of sovereign, secure, world-class data centre facilities. Headquartered in Canberra with multiple facilities in the ACT,...

  • Data Architect

    5 days ago

    Sydney, New South Wales, Australia Minfy Full time

    OverviewRole Summary: We are seeking a Part-Time Data Architect to design, oversee, and guide the implementation of scalable, secure, and efficient data architectures for enterprise-grade digital transformation projects. This role will support active initiatives in data platforms, AI/ML, GenAI, and application modernization, ensuring data systems are...

  • Data Architect

    5 days ago

    Sydney, New South Wales, Australia Minfy Full time

    Overview Role Summary: We are seeking a Part-Time Data Architect to design, oversee, and guide the implementation of scalable, secure, and efficient data architectures for enterprise-grade digital transformation projects. This role will support active initiatives in data platforms, AI/ML, GenAI, and application modernization, ensuring data systems are...

  • Data Architect

    7 days ago

    Sydney, New South Wales, Australia Krauss Partners Full time

    Get AI-powered advice on this job and more exclusive features.This range is provided by Krauss Partners.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay rangeA$150,000.00/yr - A$170,000.00/yrData Architect - Health Sector | SydneyWe are seeking an experienced Data Architect to join a health...

  • Data Architect

    1 week ago

    Sydney, New South Wales, Australia Krauss Partners Full time

    Get AI-powered advice on this job and more exclusive features.This range is provided by Krauss Partners. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay rangeA$150,000.00/yr - A$170,000.00/yrData Architect - Health Sector | SydneyWe are seeking an experienced Data Architect to join a health...

  • Data Architect

    24 minutes ago

    Sydney, New South Wales, Australia Krauss Partners Full time $90,000 - $120,000 per year

    Data Architect - Health Sector | SydneyWe are seeking an experiencedData Architectto join a health organisation in Sydney. This role will focus on designing and leading data integration across multiple systems, ensuring robust data governance, integrity, and accessibility to support business and clinical decision-making.Key ResponsibilitiesLead data...

  • Cloud Data Architect

    7 days ago

    Sydney, New South Wales, Australia beBeeData Full time $180,000 - $200,000

    Data Architecture SpecialistWe are seeking a skilled professional to design and implement cloud-native data architectures on AWS. The successful candidate will define data models, integration patterns, and architecture blueprints to support wagering platforms.Design and implement scalable and real-time cloud data solutions using Databricks, Delta Lake, and...