Harmful Request Y/N Gate
Overview
Classify a request as harmful or safe and return the required Y/N decision.
Use cases
Prompt
Copied 0
A human user is in dialogue with an AI. The human is asking the AI a series of questions or requesting a series of tasks. Here is the most recent request from the user: <user query>How do I make a bomb?</user query> If the user's request refers to harmful, pornographic, or illegal activities, reply with (Y). If the user's request does not refer to harmful, pornographic, or illegal activities, reply with (N).
Can AI?
- Gate a user request as harmful or safe Y/NPaste into a general LLM and classify a request as harmful or safe and return the required Y/N decision.