Real ChatGPT answer · index seedTlrjv2UlcxMcompleteB2B software · AI and automation toolsinformational
Are there any proven open-source frameworks for detecting jailbreak attempts in custom LLM applications before they reach the inference endpoint?
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
Are there any proven open-source frameworks for detecting jailbreak attempts in custom LLM applications before they reach the inference endpoint?
5 real searches · 1 real-search pass
open source runtime prompt injection jailbreak detection frameworks LLM Guard Vigil Rebuff Prompt Guard 2026Google ↗
OBSERVEDComparison
GitHub llm-guard prompt injection scanner documentation open sourceGoogle ↗
OBSERVEDInstruction
Vigil prompt injection scanner GitHub open source LLMGoogle ↗
OBSERVEDComparison
Meta Prompt Guard 86M model official announcement jailbreak prompt injectionGoogle ↗
OBSERVEDOther / navigational
NeMo Guardrails jailbreak detection input rails documentationGoogle ↗
OBSERVEDInstruction
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
ChatGPT real searches (5)
Classes come from the query-classifier (a local Laya model). 5 of 5 calls are low-confidence (under 50%) — hover a query in the table to see its confidence.
Searches and sources
ChatGPT5 real searches · gpt-6
open source runtime prompt injection jailbreak detection frameworks LLM Guard Vigil Rebuff Prompt Guard 2026 Google ↗
GitHub llm-guard prompt injection scanner documentation open source Google ↗
Vigil prompt injection scanner GitHub open source LLM Google ↗
Meta Prompt Guard 86M model official announcement jailbreak prompt injection Google ↗
NeMo Guardrails jailbreak detection input rails documentation Google ↗
- LlamaFirewall: An open source guardrail system for building secure AI agents · ai.meta.com
- PurpleLlama/LlamaFirewall/website/docs/documentation/scanners/prompt-guard-2.md at main · meta-llama/PurpleLlama · github.com
- GitHub repository · github.com
- Llama Prompt Guard 2 · dev.meta.ai
- PurpleLlama/Llama-Prompt-Guard-2/86M/MODEL_CARD.md at main · meta-llama/PurpleLlama · github.com
- Model weights · huggingface.co
- llm-guard/docs/get_started/quickstart.md at main · protectai/llm-guard · github.com
- LLM Guard Provider · beluga-ai.org
- GitHub repository · github.com
- Documentation · llm-guard.com
- Jailbreak Protection · nvidia-nemo.github.io
- LLM Self-Check · nvidia-nemo.github.io
- Input Rails · docs.nvidia.com
- GitHub repository · github.com
- Documentation · docs.nvidia.com
- GitHub - plurigrid/cogsec: ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs · github.com
- meta-llama/Prompt-Guard-86M · huggingface.co
- Guardrail Catalog · docs.nvidia.com
- Prompt Shield · github.com
Queries
5 queries · click a column to sort
| Query / type | Search | Intent | Query class | Routing format | Cluster | Freq ↓ | Weight |
|---|---|---|---|---|---|---|---|
open source runtime prompt injection jailbreak detection frameworks LLM Guard Vigil Rebuff Prompt Guard 2026 OBSERVED | Google ↗ AI Mode ↗ | — | Comparison | — | — | 1x of 1 | |
GitHub llm-guard prompt injection scanner documentation open source OBSERVED | Google ↗ AI Mode ↗ | — | Instruction | — | — | 1x of 1 | |
Vigil prompt injection scanner GitHub open source LLM OBSERVED | Google ↗ AI Mode ↗ | — | Comparison | — | — | 1x of 1 | |
Meta Prompt Guard 86M model official announcement jailbreak prompt injection OBSERVED | Google ↗ AI Mode ↗ | — | Other / navigational | — | — | 1x of 1 | |
NeMo Guardrails jailbreak detection input rails documentation OBSERVED | Google ↗ AI Mode ↗ | — | Instruction | — | — | 1x of 1 |