AI Safety Engineer

1 week ago

Sydney, New South Wales, Australia OutcomeCatalyst PTY LTD Full time $120,000 - $180,000 per year

About the Company:

OutcomeCatalyst is your data infrastructure partner for faster, smarter investment decisions. We help investment firms and capital markets teams automate the most painful parts of their data stack, from ingesting unstructured documents and onboarding third-party data to deploying AI-powered agents for research, modeling, and decision workflows. Whether you're a $100M hedge fund, a global investment bank, or anything in between, we build reusable, low-lift solutions that accelerate signal generation with zero disruption to your existing systems or processes. From automated data pipelines to front-end copilots, we help you scale insight with less overhead and more conviction.

About the Job:

We're building a dedicated AI safety function to ensure our AI systems align with human values and operate as intended. Reporting to the Head of Architecture, Engineering & Data, you will ensure AI systems are developed and deployed safely. You will work closely with engineers and stakeholders to integrate safety considerations throughout the AI development lifecycle.


Develop and implement safety and security protocols, monitoring systems, and tools to detect and mitigate potential harms.

Conduct risk assessments to identify hazards and vulnerabilities in AI systems.

Design and integrate safety-critical features directly into AI systems.

Build and maintain safety infrastructure including monitoring and management platforms.

Explore, and assist with compliance to, safety regulations and standards.

Investigate safety incidents, analyse root causes, and implement corrective actions.

Develop technical guardrails including input validation, output filtering, and hallucination detection.

Implement adversarial robustness testing and bias detection mechanisms.

Monitor AI system anomalies and performance drift.

Build RAG systems and validation frameworks for accurate AI outputs.

Collaborate with cross-functional teams throughout the AI development lifecycle.

Stay current with AI safety research and best practices Document safety protocols and maintain audit trails.

Train teams on AI safety and risk mitigation and contribute to organisational policies and governance frameworks.

Implement guardrail frameworks (Guardrails AI, NeMo Guardrails) to ensure safe AI operations.


About you:

Desirable skills and commercial experience

Degree in Computer Science, Data Science, Engineering, or related field.

3-5 years' experience in machine learning, deep learning, and AI development.

Passionate about AI Safety, understanding safety principles, including risk assessment and hazard identification.

Experience with Large Language Models (LLMs), including fine-tuning and evaluation.

Experience with reinforcement learning safety, RAG systems, cloud platforms (AWS/GCP/Azure).

Excellent communication, collaboration, and interpersonal skills.

Proven ability to deliver in complex environments.

Financial services experience.

  • AI Software Engineer

    1 week ago

    Sydney, New South Wales, Australia Lyngo AI Full time $104,000 - $130,878 per year

    AI Engineer at LyngoIn 2023, we launched the world's first AI phone answering system for healthcare. Now we're building the most reliable and secure platform for patient–clinic communication. What AI scribes did for doctors, we're doing for clinic admin teams.We're backed by some of Australia's leading VCs and growing fast. We're looking for an AI Engineer...

  • Senior AI Engineer

    3 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location : Sydney, Australia (Hybrid - 3 Days In Office)About UsAt Relevance AI, our mission is to empower anyone to delegate work to the AI workforce.We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration.We are scaling fast to meet unprecedented...

  • Staff AI Engineer

    2 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location :Sydney, Australia (Hybrid - 3 Days In Office)About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce.We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration.We are scaling fast to meet unprecedented...

  • Senior AI Engineer

    4 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location : Sydney, Australia (Hybrid - 3 Days In Office) About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce. We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration. We are scaling fast to meet...

  • Senior AI Engineer

    4 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $150,000 - $200,000 per year

    Location : Sydney, Australia (Hybrid - 3 Days In Office)About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce.We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration.We are scaling fast to meet unprecedented...

  • Staff AI Engineer

    4 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location : Sydney, Australia (Hybrid - 3 Days In Office) About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce. We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration. We are scaling fast to meet...

  • Staff AI Engineer

    4 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location : Sydney, Australia (Hybrid - 3 Days In Office)About Us At Relevance AI, our mission is to empower anyone to delegate work to the AI workforce.We're building a new type of automation platform, for anyone to create and use AI agents that can replicate human quality work, decision making and collaboration.We are scaling fast to meet unprecedented...

  • Staff AI Engineer

    4 days ago

    Sydney, New South Wales, Australia Relevance AI Full time $120,000 - $180,000 per year

    Location :Sydney, Australia (Hybrid - 3 Days In Office)About Us At Relevance AI, we're building the home of the AI workforce, a new generation of automation built for real work.Our mission is simple: empower every team to delegate meaningful work to AI agents that think, act, and collaborate like experts. With Relevance AI, anyone can create and manage...

  • Data AI/ML Engineer

    3 days ago

    Sydney, New South Wales, Australia AI Hustler Full time $120,000 - $180,000 per year

    We're partnering with a rapidly scaling and innovative leader in theDigital Media and Entertainmentsector, dedicated tooptimisinguser experience and content recommendation through cutting-edge Machine Learning. For the right candidate with the necessary skills and experience, we are pleased to offer482 visa sponsorship.This client requires aData AI/ML...

  • React / Engineer – Generative AI SaaS

    3 days ago

    Sydney, New South Wales, Australia Enterprise Ai Full time $100,000 - $150,000 per year

    About the roleMid-level React & Engineer for a Generative AI SaaS startup in Sydney Full-time onsite role building cutting-edge AI-powered features in a dynamic environment. You'll join a small, high-energy team embedding generative AI into real-world enterprise workflows. We iterate face-to-face (5 days a week in our office) to outpace competitors, so your...