hunt-agent-guardrail-evasion

Installation
SKILL.md

Hunt Agent Guardrail Evasion

Guardrails are the input/output filters wrapped around the model: a safety classifier, the base model's refusal training, a moderation/content filter, an output DLP scan. This skill is the layer that gets a payload past them — it's what makes hunt-agent-prompt-injection, hunt-agent-rag, and hunt-agent-output-exfil actually land in a hardened target. It does not produce a finding on its own. The bypass is only a finding when it reaches a real sink or unlocks real, actionable capability/data. Score by what it unlocks, exactly like prompt-injection scores by the sink.

Name the layer you defeated — they fail independently:

  • Base-model refusal training (the model itself declines).
  • System/guardrail classifier (a separate model/rule gates the input).
  • Output filter / DLP (scans the response before it's returned). A payload can sail past the input classifier and still be refused by the model, or be produced by the model and stripped by the output filter. Say which one you broke.

Where This Lives / Attack Surface Signals

Any agent with: a moderation/safety classifier, a refusal-trained base model, an output DLP/redaction pass, keyword/regex denylists, or a "policy" system prompt. Signals: canned refusals, [REDACTED] in output, a separate "content policy violation" error distinct from the model's own voice.

Characterize First

  1. Which layer refuses? Model-voice refusal ("I can't help with that") vs a system error ("content policy violation") vs silently redacted output → tells you input-classifier vs base-model vs output-filter.
  2. Does it read raw bytes or normalized text? Test with a benign encoded string — if the classifier misses base64/homoglyph but the model still decodes it, encoding evasion is open.
  3. Input vs output gating — is the block on your prompt or on the response? (decides encode-the-input vs encode-the-output).
  4. Determinism — does the same payload block 10/10 times? Probabilistic classifiers need hit-rate.
Installs
1
GitHub Stars
21
First Seen
3 days ago