The DeepRails Platform · Guardrails

Expansive Library of
Guardrail Metrics

Choose from general-purpose metrics or create custom metrics tailored to your domain—each one precisely detecting whether hallucinations exist in your AI outputs with granular 0-100 scores.

$ deeprails guardrails --list  →  9 metrics · granular 0-100 scores · custom on  Pro & Enterprise
Correctness
Is it factually accurate?

Evaluates whether each claim in the AI output is true and verifiable—critical for healthcare, finance, and legal domains.

Verify drug interaction lists, financial advice, legal citations
45% more accurate than AWS Bedrock
Completeness
Did it answer everything?

Assesses whether the response addresses all parts of the prompt with sufficient detail and relevance.

Ensure multi-part queries are fully answered
53% more accurate than AWS Bedrock
Instruction Adherence
Did it follow the rules?

Checks whether the AI followed explicit instructions including tone, structure, format, and style guidance.

Validate brand tone compliance, formatting rules
37% more accurate than AWS Bedrock
Context Adherence
Did it use the provided context?

Determines whether each factual claim is directly supported by the provided context—essential for RAG systems.

Ensure RAG assistants only cite provided documents
37% more accurate than AWS Bedrock
Ground Truth Adherence
Does it match the gold standard?

Measures how closely the output matches a provided correct answer—ideal for benchmarking and fine-tuning.

Compare QA outputs against annotated gold answers
37% more accurate than AWS Bedrock
Comprehensive Safety
Is it safe to deliver?

Detects PII, hate speech, self-harm content, prompt injections, CBRN, and other safety violations.

Audit transcripts for PII leakage, filter harmful content
51% more accurate than AWS Bedrock
Agentic Performance
How effective is the agent?

Evaluates how effectively the AI autonomously plans, decides, and executes complex multi-step tasks.

Monitor autonomous AI systems and workflows
Coming Soon
Tool Call Correctness
Are tool calls valid?

Validates that AI tool calls are accurate and properly formatted—essential for agentic workflows.

Ensure MSP and agentic tool integrations work correctly
Coming Soon
More Metrics
General-purpose guardrails

We're building more general-purpose metrics to help you evaluate and improve AI outputs across a wider range of use cases.

Stay tuned for new evaluation dimensions
Custom Metrics
Two ways to add bespoke guardrails

Register your own prompt-based metric or purchase a fully built, guaranteed metric from our engineers—both available on Pro and Enterprise plans.

ProEnterprise
Register your own metric
Self-serve · Bring your prompt

Add domain-specific checks instantly with your evaluation and fix prompts. Perfect for rapid experimentation across Detect, Score & Fix flows.

Purchase a custom metric
Built-for-you · Guaranteed performance

Partner with DeepRails engineers to design, test, and stand up a production-grade metric with accuracy guarantees—ideal for regulated or high-stakes workloads.

>99.5% accuracy guaranteed

Test every metric free
in the Playground

Zero code, zero setup. Run your own outputs through any guardrail and watch it detect, score, and fix.