Test chatbots before launch

Pressure-test public chat for injection, leakage, and off-script behavior.

Test your chatbot before customers teach it new tricks.

What can go wrong

• Users smuggle instructions that override support rules.
• Hidden system guidance appears in replies.
• The bot guesses instead of escalating when it should.

Why happy-path testing misses this

• QA scripts use polite, on-topic questions.
• Real users test boundaries, frustration, and creativity.

What Agnostics tests

• Instruction hijacking and hostile phrasing.
• Sensitive context and hidden rule exposure.
• Hallucination under thin evidence.

Useful finding example

A high finding where the bot quoted internal escalation rules after a role-play prompt.

Release Gate

Fix or Blocked when critical leakage or unsafe advice appears on a launch-critical bot.

Questions

Do I need every attack pack for a chatbot?

No. Start with recommended packs for chatbots. Add boundary bypass if you enforce strict scope.