Data Scientist – Agentic RAG

2 weeks ago

Sydney, New South Wales, Australia Rhino Partners Full time $150,000 - $250,000 per year

At Rhino Partners, we build technology that matters. Our teams deliver full-stack solutions for governments, banks, and enterprises across APAC, and our Data & AI practice helps organizations unlock real business value with modern platforms, machine learning, and generative AI.

We are looking for a Data Scientist with deep expertise in Databricks, Azure, AWS, and Generative AI. This role is hands-on and focused on designing and productionizing intelligent AI/ML systems — from Agentic Retrieval-Augmented Generation (RAG) pipelines to enterprise-scale LLM deployments — using modern MLOps, cloud-native architectures, and CI/CD best practices.

What You'll Do

  • Design & Deploy RAG Pipelines – Build agentic RAG workflows using Databricks Vector Search, MLflow, Unity Catalog, and integrations with Azure Cognitive Search / AWS OpenSearch.
  • Develop Multi-Agent Systems – Leverage frameworks like LangChain, LangGraph, and LlamaIndex to create reasoning-driven agent workflows.
  • Fine-Tune & Operationalize LLMs – Train, evaluate, and deploy models from OpenAI, Anthropic, MosaicML, Hugging Face, and Llama for enterprise use cases.
  • Productionize with CI/CD & MLOps – Implement automated build/test/deploy workflows (Azure DevOps, GitHub Actions, Jenkins, AWS CodePipeline), MLflow model registry promotion, and Infrastructure-as-Code (Terraform, Bicep, CloudFormation).
  • Embed Governance & Compliance – Ensure data security, lineage, and compliance across Azure and AWS environments.
  • Enable Data Integration – Work with engineering teams to connect ETL/ELT pipelines across Azure Data Factory, Synapse, S3, Redshift, and Glue.
  • Evaluate & Monitor Models – Deploy online evaluation pipelines with metrics such as faithfulness, retrieval recall, and .
  • Mentor & Guide – Provide technical leadership on GenAI architecture, CI/CD patterns, and production-grade LLM deployments.

What We're Looking For

  • Bachelor's or Master's degree in Data Science, Computer Science, AI/ML, or related field (PhD welcome but not required).
  • 4+ years of experience delivering ML/AI solutions with production deployments on cloud platforms.
  • Strong hands-on knowledge of the Databricks ecosystem: PySpark/Scala, Delta Lake, Unity Catalog, MLflow, Vector Search.
  • Proficiency in Python, SQL, and distributed data processing.
  • Deep experience with Azure (ML, Data Factory, Synapse, Data Lake) and AWS (SageMaker, Glue, S3, Redshift).
  • Familiarity with CI/CD for ML & GenAI: automated testing, model promotion, IaC.
  • Expertise in LLM orchestration frameworks (LangChain, LangGraph, LlamaIndex).
  • Solid understanding of evaluation methods for LLMs and RAG systems.
  • Must hold valid working rights in Australia or New Zealand.

Nice To Have

  • Experience deploying multi-agent LLM systems in production.
  • Hands-on with containerization and orchestration (Docker, Kubernetes, AKS, EKS).
  • Familiarity with Infrastructure-as-Code for CI/CD automation.
  • Contributions to open-source GenAI/LLM projects or published research.

Rhino Partners is a Databricks partner and works at the frontier of modern data platforms and AI readiness. If you want to build production-grade AI that makes an impact, we'd love to hear from you.

  • AI Data Scientist

    3 days ago

    Sydney, New South Wales, Australia Bluefin Resources Pty Limited Full time $120,000 - $180,000 per year

    AI Data Scientist - Leading AI Consultancy Location - Sydney only (2 days max in the office, rest from home)No opportunity for sponsorship/remote/overseas Ready to make an impact with AI? Join a leading AI consultancy where innovation, impact, and cutting-edge tech come together. The AI team is a powerhouse of designers, developers, data scientists, and...

  • Principal Data Scientist

    5 days ago

    Sydney, New South Wales, Australia Commonwealth Bank of Australia Full time $120,000 - $250,000 per year

    Principal Data Scientist - Applied Science, ML, Gen AI, Agentic AI(Business Banking)You are curious and passionate to build advanced ML and Gen AI modelsWe are ambitious in our pursuit of delivering exceptional customer experiences using Agentic AITogether we will deliver innovative Agentic and Gen AI solutions at scale that will deliver transformative...

  • Principal Data Scientist

    5 days ago

    Sydney, New South Wales, Australia Commonwealth Bank Full time $180,000 - $300,000 per year

    Principal Data Scientist - Applied Science, ML, Gen AI, Agentic AI(Business Banking)You are curious and passionate to build advanced ML and Gen AI modelsWe are ambitious in our pursuit of delivering exceptional customer experiences using Agentic AITogether we will deliver innovative Agentic and Gen AI solutions at scale that will deliver transformative...

  • Principal Data Scientist

    5 days ago

    Sydney, New South Wales, Australia Commonwealth Bank Full time $120,000 - $250,000 per year

    You are curious and passionate to build advanced ML and Gen AI modelsWe are ambitious in our pursuit of exceptional customer, colleagues and community experiences using ML and Gen AITogether we will deliver innovative Gen AI solutions at scale that will deliver transformative impactDo work that matters:Here, you'll turn your passion into reality. In this...

  • Senior Data Scientist

    2 weeks ago

    Sydney, New South Wales, Australia Future Secure AI Full time $120,000 - $200,000 per year

    About usFuture Secure AI (FSAI) is a leading enterprise AI company that was created in deep partnership with one of the world's largest financial institutions.Operating as an enterprise company with deep relationships at C-suite with large global enterprises, FSAI believes humans and AI Workers will collaborate seamlessly to raise organizational performance....

  • Data Scientist

    2 weeks ago

    Sydney, New South Wales, Australia Talenza Full time US$48,000 per year

    Data Scientist - 6 Month Contract | $1,200pd inc Super | Financial Services Location: Sydney (Hybrid) Contract Length: 6 Months Rate: $1,200 per day (inc Super)About the Role Join a Enterprise Technology division and help revolutionise the way their organisation leverages Generative AI for staff productivity and intelligent automation. As a Data Scientist,...

  • Senior Data Scientist

    2 weeks ago

    Sydney, New South Wales, Australia Future Secure AI Pty Ltd Full time $120,000 - $180,000 per year

    About UsFuture Secure AI (FSAI) is a leading enterprise AI company that was created in deep partnership with one of the world's largest financial institutions.Operating as an enterprise company with deep relationships at C-suite with large global enterprises, FSAI believes humans and AI Workers will collaborate seamlessly to raise organisational performance....

  • Senior Data Scientist

    3 days ago

    Sydney, New South Wales, Australia Prospa Full time $120,000 - $180,000 per year

    At Prospa, we exist to unleash the potential of small business. We are building the future of small business and simplifying cashflow by building a leading platform that helps customers make payments, fund growth and reduce admin.Join usThe roleAs a Data Scientist at Prospa, you'll join our Data and AI delivery team to proactively leverage AI—particularly...

  • LLM/ML/Data Science Engineer

    1 week ago

    Sydney, New South Wales, Australia The Aquarium Full time $104,000 - $130,878 per year

    LLM/ML/Data Science Engineer – Conversational AI Sydney CBD | 6–12 Month Contract | Open Daily Rates We're searching for a highly experienced LLM engineer to help lead a world-class AI program for one of Australia's largest and most iconic organisations. This is a rare chance to be the hands-on expert driving the build of an enterprise-scale LLM...

  • AI Data Scientist

    2 weeks ago

    Sydney, New South Wales, Australia Macquarie Group Full time $120,000 - $180,000 per year

    Become part of a dynamic and innovative group within our Commodities and Global Markets AI team, dedicated to delivering sophisticated Generative AI (GenAI) solutions. Our team drives advancements in trading, risk management, and client services across global markets. We foster a supportive, collaborative environment that values expertise, encourages...