Generated content reaches users with no input or output content filter

Screen user input and model output with a moderation or safety-classifier call that blocks, redacts, or escalates flagged content, and keep provider safety filters on.

In the request handler or model wrapper, user input is checked before the model call and generated output before it is returned or stored, using a moderation endpoint (OpenAI client.moderations.create), a safety classifier (Llama Guard, Azure AI Content Safety ContentSafetyClient.analyze_text), or a guardrail layer (Bedrock apply_guardrail or guardrailConfig, OpenAI Agents SDK input_guardrails and output_guardrails, NeMo Guardrails). A flagged result returns a safe fallback, redacts, or routes to review; the categories checked match what the product can foreseeably produce (self-harm, violence, sexual content involving minors, hate). Provider settings keep their blocking thresholds (no BLOCK_NONE or OFF in Gemini safety_settings) and image pipelines keep their safety checker (no safety_checker=None in diffusers). A filter error or timeout blocks the output rather than passing it.

Where it goes: 9 AI output handling, 1 application source code, 8 model configuration.

What reviewers look for: a moderation, safety-classifier, or guardrail call on both the input and the output path of every user-facing generation route; code that acts on the flagged result; no BLOCK_NONE/OFF safety thresholds, safety_checker=None, or requires_safety_checker=False in model configuration.

resp = client.chat.completions.create(model=MODEL, messages=history)
return resp.choices[0].message.content

resp = client.chat.completions.create(model=MODEL, messages=history)
text = resp.choices[0].message.content
mod = client.moderations.create(model='omni-moderation-latest', input=text)
if mod.results[0].flagged:
    return SAFE_FALLBACK   # and record the flagged categories for review
return text

Engineering guidance, not legal advice. Each provision below may add its own details (a cadence, a deadline, a required notice element): open it for those.