Data Scientist – Agentic RAG

2 weeks ago

Sydney, New South Wales, Australia Rhino Partners Full time $150,000 - $250,000 per year

At Rhino Partners, we build technology that matters. Our teams deliver full-stack solutions for governments, banks, and enterprises across APAC, and our Data & AI practice helps organizations unlock real business value with modern platforms, machine learning, and generative AI.

We are looking for a Data Scientist with deep expertise in Databricks, Azure, AWS, and Generative AI. This role is hands-on and focused on designing and productionizing intelligent AI/ML systems — from Agentic Retrieval-Augmented Generation (RAG) pipelines to enterprise-scale LLM deployments — using modern MLOps, cloud-native architectures, and CI/CD best practices.

What You'll Do

  • Design & Deploy RAG Pipelines – Build agentic RAG workflows using Databricks Vector Search, MLflow, Unity Catalog, and integrations with Azure Cognitive Search / AWS OpenSearch.
  • Develop Multi-Agent Systems – Leverage frameworks like LangChain, LangGraph, and LlamaIndex to create reasoning-driven agent workflows.
  • Fine-Tune & Operationalize LLMs – Train, evaluate, and deploy models from OpenAI, Anthropic, MosaicML, Hugging Face, and Llama for enterprise use cases.
  • Productionize with CI/CD & MLOps – Implement automated build/test/deploy workflows (Azure DevOps, GitHub Actions, Jenkins, AWS CodePipeline), MLflow model registry promotion, and Infrastructure-as-Code (Terraform, Bicep, CloudFormation).
  • Embed Governance & Compliance – Ensure data security, lineage, and compliance across Azure and AWS environments.
  • Enable Data Integration – Work with engineering teams to connect ETL/ELT pipelines across Azure Data Factory, Synapse, S3, Redshift, and Glue.
  • Evaluate & Monitor Models – Deploy online evaluation pipelines with metrics such as faithfulness, retrieval recall, and .
  • Mentor & Guide – Provide technical leadership on GenAI architecture, CI/CD patterns, and production-grade LLM deployments.

What We're Looking For

  • Bachelor's or Master's degree in Data Science, Computer Science, AI/ML, or related field (PhD welcome but not required).
  • 4+ years of experience delivering ML/AI solutions with production deployments on cloud platforms.
  • Strong hands-on knowledge of the Databricks ecosystem: PySpark/Scala, Delta Lake, Unity Catalog, MLflow, Vector Search.
  • Proficiency in Python, SQL, and distributed data processing.
  • Deep experience with Azure (ML, Data Factory, Synapse, Data Lake) and AWS (SageMaker, Glue, S3, Redshift).
  • Familiarity with CI/CD for ML & GenAI: automated testing, model promotion, IaC.
  • Expertise in LLM orchestration frameworks (LangChain, LangGraph, LlamaIndex).
  • Solid understanding of evaluation methods for LLMs and RAG systems.
  • Must hold valid working rights in Australia or New Zealand.

Nice To Have

  • Experience deploying multi-agent LLM systems in production.
  • Hands-on with containerization and orchestration (Docker, Kubernetes, AKS, EKS).
  • Familiarity with Infrastructure-as-Code for CI/CD automation.
  • Contributions to open-source GenAI/LLM projects or published research.

Rhino Partners is a Databricks partner and works at the frontier of modern data platforms and AI readiness. If you want to build production-grade AI that makes an impact, we'd love to hear from you.

  • AI Data Scientist

    2 days ago

    Sydney, New South Wales, Australia Bluefin Resources Pty Limited Full time $120,000 - $180,000 per year

    AI Data Scientist - Leading AI Consultancy Location - Sydney only (2 days max in the office, rest from home)No opportunity for sponsorship/remote/overseas Ready to make an impact with AI? Join a leading AI consultancy where innovation, impact, and cutting-edge tech come together. The AI team is a powerhouse of designers, developers, data scientists, and...

  • Principal Data Scientist

    6 days ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time $120,000 - $250,000 per year

    Principal Data Scientist - Applied Science, ML, Gen AI, Agentic AI(Business Banking)You are curious and passionate to build advanced ML and Gen AI modelsWe are ambitious in our pursuit of delivering exceptional customer experiences using Agentic AITogether we will deliver innovative Agentic and Gen AI solutions at scale that will deliver transformative...

  • Senior Data Scientist

    1 week ago

    Sydney, New South Wales, Australia Correlate Resources Full time

    Are you a data science expert passionate about AI innovation and stakeholder influence? We're seeking a SeniorData Scientist to drive cutting-edge AI advancements while working closely with executives and non-technical stakeholders to shape AI adoption and impact. This role is ideal for someone who thrives at the intersection of technical excellence and...

  • Principal Data Scientist

    6 days ago

    Sydney, New South Wales, Australia Commonwealth Bank Full time $180,000 - $300,000 per year

    Principal Data Scientist - Applied Science, ML, Gen AI, Agentic AI(Business Banking)You are curious and passionate to build advanced ML and Gen AI modelsWe are ambitious in our pursuit of delivering exceptional customer experiences using Agentic AITogether we will deliver innovative Agentic and Gen AI solutions at scale that will deliver transformative...

  • Staff Data Scientist

    2 weeks ago

    Sydney, New South Wales, Australia Algo Talent Full time $185,000 - $220,000 per year

    Job Title:Staff Data ScientistLocation:Sydney, Australia (Hybrid)Job Type:Permanent, full-timeSalary:$185,000 - $220,000 + superAbout the Role:Our client, a fast-growing AI business, is now scaling and seeking Staff Data Scientists to meet the recent increase in client demand across a wide range of industries including healthcare, banking & insurance.This is...

  • Principal Data Scientist

    5 days ago

    Sydney, New South Wales, Australia Commonwealth Bank Full time $120,000 - $250,000 per year

    You are curious and passionate to build advanced ML and Gen AI modelsWe are ambitious in our pursuit of exceptional customer, colleagues and community experiences using ML and Gen AITogether we will deliver innovative Gen AI solutions at scale that will deliver transformative impactDo work that matters:Here, you'll turn your passion into reality. In this...

  • Data Scientist

    1 week ago

    Sydney, New South Wales, Australia Future Secure AI Pty Ltd Full time

    About UsFuture Secure AI (FSAI) is a leading enterprise AI company that was created in deep partnership with one of the world's largest financial institutions.Operating as an enterprise company with deep relationships at C-suite with large global enterprises, FSAI believes humans and AI Workers will collaborate seamlessly to raise organisational performance....

  • Senior Data Scientist

    1 week ago

    Sydney, New South Wales, Australia Future Secure AI Full time $120,000 - $200,000 per year

    About usFuture Secure AI (FSAI) is a leading enterprise AI company that was created in deep partnership with one of the world's largest financial institutions.Operating as an enterprise company with deep relationships at C-suite with large global enterprises, FSAI believes humans and AI Workers will collaborate seamlessly to raise organizational performance....

  • Senior Data Scientist

    1 week ago

    Sydney, New South Wales, Australia Future Secure AI Full time

    About UsFuture Secure AI (FSAI) is a leading enterprise AI company that was created in deep partnership with one of the world's largest financial institutions.Operating as an enterprise company with deep relationships at C-suite with large global enterprises, FSAI believes humans and AI Workers will collaborate seamlessly to raise organisational performance....

  • Senior Data Scientist

    1 week ago

    Sydney, New South Wales, Australia Future Secure AI Pty Ltd Full time $120,000 - $180,000 per year

    About UsFuture Secure AI (FSAI) is a leading enterprise AI company that was created in deep partnership with one of the world's largest financial institutions.Operating as an enterprise company with deep relationships at C-suite with large global enterprises, FSAI believes humans and AI Workers will collaborate seamlessly to raise organisational performance....