Real-Time Data Architect

5 days ago

Sydney, New South Wales, Australia beBeeDataEngineer Full time $160,000 - $200,000
Job Title

The Principal Data Platforms Engineer at Simple Machines is a dynamic, hands-on role focused on building real-time data pipelines and implementing data mesh architectures to enhance client data interactions.

This position blends deep technical expertise in modern data engineering methods with a client-facing consulting approach, enabling clients to effectively manage and utilise their data.

  • Design & Architecture: Design and architect scalable solutions using Databricks Lakehouse Architecture, applying best practices around Delta Lake, data modeling, and distributed processing.
  • Developing Data Solutions: Implement and enhance data-driven solutions integrating with clients' systems using state-of-the-art tools such as Databricks, Snowflake, Google Cloud, and AWS.
  • Data Pipeline Development: Develop and optimise high-performance, batch and real-time data pipelines employing advanced streaming technologies like Kafka, and Flink.
  • Database and Storage Optimisation: Optimise and manage a broad array of database technologies, from traditional relational databases (e.g., PostgreSQL, MySQL) to modern NoSQL solutions (e.g., MongoDB, Cassandra).

Key skills include:

  • Hands-on experience in Databricks
  • Proficiency in SQL and Spark
  • Familiarity with platforms such as Databricks and Snowflake
  • Well-versed in various storage technologies including AWS S3, Google Cloud BigQuery, Cassandra, MongoDB, Neo4J, and HDFS
  • Adept in pipeline orchestration tools like AWS Glue, Apache Airflow, and dbt, as well as streaming technologies like Kafka, AWS Kinesis, Google Cloud Pub/Sub, and Azure Event Hubs

  • Senior Data Infrastructure Specialist

    3 days ago

    Sydney, New South Wales, Australia beBeeData Architect Full time $160,000 - $200,000

    Job SummaryWe are seeking an accomplished data architect to spearhead the development of a hybrid on-premises and cloud-based data platform. This position demands expertise in designing scalable, high-performance data infrastructure that supports trading, research, and operations by ensuring accurate, timely, and accessible data.About the RoleCreate...

  • Real-Time Data Architect

    1 week ago

    Sydney, New South Wales, Australia beBeeDataEngineer Full time $160,000 - $200,000

    Job Overview:The role of Senior Data Operations Engineer involves designing, building, and maintaining scalable and robust data platforms for Integration Platform teams.You will be responsible for developing real-time data streaming, distribution, and secure file transfer platforms using Confluent Platform and CrushFTP.This is a hands-on engineering and...

  • Solutions Architect

    1 week ago

    Sydney, New South Wales, Australia Real Time Full time $150,000 - $200,000 per year

    What if your next role gave you the opportunity to create solutions that haven't yet been seen, and the equity to change your life?This is a rare opportunity to join the leadership team of a well-funded, high-growth AI company as the single owner of technology and product. Our revolutionary client has a very successful V1 product which has attracted major...

  • Data Architect

    1 week ago

    Sydney, New South Wales, Australia Resource Corner Full time $100,000 - $150,000 per year

    Role: Data Solution ArchitectLocation: SydneyDuration: FulltimeDescriptionKey ResponsibilitiesData Architecture & StrategyDesign and implement cloud native data architectures on AWS leveraging Databricks, Delta Lake, and other modern data tools.Define data models, integration patterns, and architecture blueprints to support wagering platforms (bets, odds,...

  • Data Architect

    7 days ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    OverviewDrive long-term value and innovation through data-led transformationBe involved in key transformation projectsMake Your Mark – Newly Created PositionAbout usEstablished in 2007, CDC Data Centresis Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW,...

  • Data Architect

    5 days ago

    Sydney, New South Wales, Australia Cdc Data Centres Full time

    Drive long-term value and innovation through data-led transformation Be involved in key transformation projects Make Your Mark – Newly Created Position About us:Established in 2007, CDC Data Centres is Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW,...

  • Data Architect

    2 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    OverviewDrive long-term value and innovation through data-led transformation Be involved in key transformation projects Make Your Mark – Newly Created Position About us Established in 2007, CDC Data Centresis Australia's leading operator of sovereign, secure, world-class data centre facilities. Headquartered in Canberra with multiple...

  • Data Architect

    2 weeks ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    OverviewDrive long-term value and innovation through data-led transformationBe involved in key transformation projectsMake Your Mark – Newly Created PositionAbout usEstablished in 2007, CDC Data Centresis Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW,...

  • Data Architect

    1 week ago

    Sydney, New South Wales, Australia CDC Data Centres Full time $100,000 - $150,000 per year

    Drive long-term value and innovation through data-led transformationBe involved in key transformation projectsMake Your Mark – Newly Created PositionAbout us:Established in 2007, CDC Data Centres is Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW, VIC...

  • Senior Data Architect

    1 day ago

    Sydney, New South Wales, Australia beBeeData Full time $150,000 - $250,000

    Job Title: Senior Data ArchitectOverview of Role:We are seeking an accomplished data architect to spearhead the design, implementation, and maintenance of robust data solutions. This key role focuses on aligning with enterprise architecture standards, governance policies, and business needs.The Position:This senior data architect will be responsible for...