Agentic AI Architect

2 days ago

Sydney, New South Wales, Australia N2S Full time $180,000 - $250,000 per year

Job Title
: Agentic AI Architect

Exp. Level
: 12-15yrs

Location:
Sydney/Melbourne/AU offices

Job Description
:

We are seeking passionate and innovative Agentic AI Technology team to join our organization.

As an Architect in Agentic AI technology, you will work to lead to the development of scalable, benchmark-driven evaluation framework for Agentic AI system. This role is pivotal in enabling the deployment of scalable multi-agent AI architecture (20–30+ agents) in production, with a strong emphasis on Agent-Level and System-Level evaluation in compliance-heavy domains such as finance and banking.

Responsibilities:

  • Develop and propose the solution architecture for scalable Agentic AI (Multiple Agents) evaluation framework.
  • Develop and implement framework leveraging advanced AI Agents using models such as OpenAI GPT, Anthropic Clude, Meta Llama2, Google Gemini etc. focusing on enhancing developer and business productivity.
  • Knowledge of mapping suitable LLMs according to agent roles (e.g., DevSecOps Agent with OpenAI).
  • Must have experience with Agentic AI frameworks like
    LangGraph, CrewAI, AutoGen etc.
  • Must have experience in framework evaluation tools and techniques such as AgentBench, RAGAS and OpenAI Evals
    .
  • Architect solution incorporating advanced techniques like Retrieval Augmented Generation (RAG), Prompt Engineering ensuring optimal performance and scalability.
  • Must know how to measure and benchmark the performance of the Agents.
  • Drive end-to-end implementation and deployment with extensive knowledge of Azure and AWS services.
  • Understanding and experience in LLMOps and AgentOps with multi-agent coordination and debugging.
  • Stay abreast of emerging trends, complex patterns, data dependencies, and advancements in AI architecture, contributing to the refinement and innovation of application development processes.

Qualifications:

  • Bachelor's degree or master's degree (or equivalent experience) or PhD in Computer Science, Electrical Engineering, Artificial Intelligence, or Applied Math with 8+ years of experience, with at least 1.5 years of hand-on in GenAI.
  • Excellent programming skills in Python with strong fundamentals in programming, optimizations and software design.
  • Proven expertise in designing scalable evaluation systems for GenAI, RAG, or multi-agent architectures.
  • Experience with agentic AI frameworks (e.g., LangChain, CrewAI, AutoGPT), RAG pipelines and orchestration tools.
  • Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment.

  • AI Agent Solutions Engineer

    2 weeks ago

    Sydney, New South Wales, Australia Relevance AI Full time US$120,000 - US$150,000 per year

    Location :Sydney, Australia (Hybrid - 3 Days In Office)About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce.We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration.We are scaling fast to meet unprecedented...

  • AI Architect

    5 days ago

    Sydney, New South Wales, Australia Rethink Investing AUS & NZ Full time $180,000 - $250,000 per year

    Rethink Group | Sydney, AustraliaAbout the RoleYou will architect, guide the implementation of, and strategically deploy a wide spectrum of sophisticated AI systems. This role demands a synthesis ofdeep AI/ML expertise, robust software and platform engineering skills, and creative problem-solving.As aCreative AI Architect, you will be instrumental in...

  • Agentic AI Lead

    2 days ago

    Sydney, New South Wales, Australia PhoenixDX Full time $120,000 - $250,000 per year

    Agentic AI Lead at PhoenixDX — a senior role blending thought leadership, client evangelism, and hands-on technical delivery to scale next-gen AI solutions.PhoenixDX is one of Australia's fastest-growing digital innovation companies. We specialise in rapid application development using the latest low-code enterprise platforms, legacy modernisation, leading...

  • Principal, AI Domain Architect

    4 weeks ago

    Sydney, New South Wales, Australia IAG Full time

    OverviewJoin to apply for the Principal, AI Domain Architect role at IAG.This is a permanent role with exciting opportunities for growth and learning, open to candidates based in Gadigal Country (Sydney) and Naarm (Melbourne).ResponsibilitiesArchitect and scale AI, ML, and Generative AI platforms, development and deployment patterns, including MLOps, LLMOps,...

  • Principal, AI Domain Architect

    4 weeks ago

    Sydney, New South Wales, Australia IAG Full time

    OverviewJoin to apply for the Principal, AI Domain Architect role at IAG.This is a permanent role with exciting opportunities for growth and learning, open to candidates based in Gadigal Country (Sydney) and Naarm (Melbourne).ResponsibilitiesArchitect and scale AI, ML, and Generative AI platforms, development and deployment patterns, including MLOps, LLMOps,...

  • Senior AI Engineer

    3 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location : Sydney, Australia (Hybrid - 3 Days In Office)About UsAt Relevance AI, our mission is to empower anyone to delegate work to the AI workforce.We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration.We are scaling fast to meet unprecedented...

  • Staff AI Engineer

    2 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location :Sydney, Australia (Hybrid - 3 Days In Office)About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce.We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration.We are scaling fast to meet unprecedented...

  • Senior AI Engineer

    3 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location : Sydney, Australia (Hybrid - 3 Days In Office) About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce. We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration. We are scaling fast to meet...

  • Senior AI Engineer

    3 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $150,000 - $200,000 per year

    Location : Sydney, Australia (Hybrid - 3 Days In Office)About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce.We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration.We are scaling fast to meet unprecedented...

  • Staff AI Engineer

    3 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location : Sydney, Australia (Hybrid - 3 Days In Office)About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce.We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration.We are scaling fast to meet unprecedented...