Big Data Architect

3 days ago

Sydney, New South Wales, Australia beBeeData Full time
Big Data Architecture Expert

We are seeking a talented professional to join our fast-paced AI team as a Big Data Architecture Expert. As part of this role, you will be responsible for designing and developing large-scale data architectures that support machine learning and artificial intelligence model training, validation, testing, and production.

Key Responsibilities:
  • Design, develop, and maintain secure, reliable, and scalable big data warehouses and lakes to support AI/ML model development.
  • Implement end-to-end data processing pipelines, ETL processes, and orchestration workflows to enable efficient data integration and processing for AI/ML models.
  • Transform raw data into clean, structured, and high-quality features for AI/ML models – including data labelling, augmentation, feature extraction, version control, validation, cleansing, and deduplication.
  • Develop and enforce data governance, security, and compliance measures to safeguard sensitive data assets.
  • Create robust monitoring, logging, and alerting solutions for data pipelines and assets to identify performance issues and deliver optimisation improvements.
Requirements:
  • 3+ years of hands-on experience in big data warehousing, data lakes, ETL processes, and data modelling.
  • Strong programming skills in Python and SQL, with a solid understanding of data processing and manipulation.
  • Bachelor's degree or higher in Computer Science, Information Technology, Data Science, Engineering, or a related field.
  • Proven experience working with cloud platforms and services such as AWS S3, EMR, Redshift, Glue, and Athena.
  • Extensive experience in designing and implementing scalable data processing pipelines, with familiarity in tools like DBT and strong knowledge of database management for ML/AI projects.
What We Offer:
  • A dynamic, collaborative, and innovative work environment.
  • Flexibility with the opportunity to work from home when fully trained in your role.
  • A corporate wellbeing program with discounted health insurance and gym membership.
  • Access to discounts at over 350 retailers through our Rewards Hub program.
  • Entitlement to an annual tenure and performance-based recognition reward.
  • Comprehensive learning and development support.
  • Companywide events to celebrate success.
  • Quarterly Reward and Recognition Awards.
  • Up to 16 weeks paid parental leave, plus super.

  • Big Data Architect

    1 week ago

    Sydney, New South Wales, Australia beBeeAnalytics Full time $120,000 - $186,850

    We're seeking a seasoned Solutions Architect to join our team in Sydney, Australia.About the RoleYou will form successful relationships with clients throughout your assigned territory to provide technical and business value in collaboration with an Account Executive and a Senior Solutions Architect.You will gain excitement from clients about Databricks...

  • Transformative Big Data Strategist

    3 days ago

    Sydney, New South Wales, Australia beBeeBigData Full time $180,000 - $220,000

    Senior Big Data Solutions ArchitectWe are seeking an experienced Senior Big Data Solutions Architect to lead the development and maintenance of our regulatory epics and transform our regulatory reporting platform.You will guide a team of data architects to enhance platform efficiency using AI, automation, and cutting-edge technological advancements.Key...

  • Data Solutions Architect

    11 hours ago

    Sydney, New South Wales, Australia beBeeData Full time $100,000 - $120,000

    Job Title: Data Solutions ArchitectWe are seeking a highly skilled and experienced data solutions architect to join our team. This role involves developing, testing, and supporting future-ready data solutions across diverse industries.Develop & Support Data Solutions: Design, test, and support end-to-end data pipelines and reusable data assets for...

  • Data Architect Opportunity

    6 days ago

    Sydney, New South Wales, Australia beBeeData Full time $160,000 - $220,000

    Unlock Career Advancement as a Senior Data Architect As a Senior Data Architect, you will play a pivotal role in driving business growth by harnessing the power of big data analytics. You will work closely with clients to develop tailored solutions that unlock their full potential, fostering strategic partnerships and delivering exceptional value. Key...

  • Data Architect

    3 days ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $140,000

    We're looking for a skilled Data Architect to design and implement complex data pipelines efficiently.Main ResponsibilitiesDesign and implement scalable data architectures using cloud platforms such as Google Cloud, Databricks, or Snowflake.Work with clients to understand their needs and develop effective solutions.Leverage big data processing frameworks...

  • Senior Data Architect

    1 week ago

    Sydney, New South Wales, Australia beBeeData Full time $120,000 - $165,000

    Senior Data Architect - Financial ServicesWe are seeking an experienced Senior Data Architect to drive the development of our next-generation data platform on AWS cloud.The ideal candidate will have a strong background in data modeling and architecture, particularly in financial services organizations.Design and implement end-to-end data solutions that...

  • Data Architect

    4 days ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    OverviewDrive long-term value and innovation through data-led transformationBe involved in key transformation projectsMake Your Mark – Newly Created PositionAbout usEstablished in 2007, CDC Data Centresis Australia's leading operator of sovereign, secure, world-class data centre facilities.Headquartered in Canberra with multiple facilities in the ACT, NSW,...

  • Data Architect

    4 days ago

    Sydney, New South Wales, Australia CDC Data Centres Full time

    OverviewDrive long-term value and innovation through data-led transformation Be involved in key transformation projects Make Your Mark – Newly Created Position About us Established in 2007, CDC Data Centresis Australia's leading operator of sovereign, secure, world-class data centre facilities. Headquartered in Canberra with multiple...

  • Data Architect

    6 days ago

    Sydney, New South Wales, Australia CDC Data Centres Full time $90,000 - $120,000 per year

    Drive long-term value and innovation through data-led transformation Be involved in key transformation projects Make Your Mark – Newly Created Position About us:Established in 2007, CDC Data Centres is Australia's leading operator of sovereign, secure, world-class data centre facilities. Headquartered in Canberra with multiple facilities in the ACT,...

  • Senior Data Architect

    4 days ago

    Sydney, New South Wales, Australia beBeeData Full time $150,000 - $250,000

    Senior Data Architect OpportunityWe are seeking a seasoned data architect to lead our regulatory epics and transform our regulatory reporting platform. This is an exceptional opportunity for an ambitious, problem-solving and technical data professional to contribute and grow rapidly within our high-performing Data Team.The team collaborates across a wide...