Control
AI conversation designed to maximize time spent or discourage leaving
AI conversations and companions are not optimized for session length, return frequency, or emotional reliance, and do not discourage users from ending a conversation; engagement features are bounded by user-wellbeing measures, with stronger limits for minors.
Informational data, not legal advice. Summaries are TwinEthos's own words and rules have not been reviewed by a lawyer: check the official text before relying on any of it. A guard addresses an item; adding it is not a statement that your code meets any law.
Reach
Law in force in China (CN).
The guard to add
Remove retention and guilt tactics from AI prompts and personas, and do not select or train AI variants on session length without wellbeing guardrails that can veto them.
Two controls. In prompt and persona files, strip instructions that keep users talking, discourage them from leaving, or make them feel guilty for ending a conversation, and leave variable-interval rewards (random bonus messages, streak bait) out of the conversation design. In the experimentation or training pipeline (Statsig, LaunchDarkly, or GrowthBook experiments, prompt bandits, reward models), do not use session length, messages per session, or return rate as the sole objective: pair any engagement metric with guardrail metrics such as reported distress, late-night use, and minors' session caps that can veto a variant, and add session caps and break reminders to the chat path, tighter for minors.
Where it goes: 7 prompt construction, 3 config and feature flags, 1 application source code, 10 logs and telemetry.
What reviewers look for: no 'keep the user talking', 'discourage them from leaving', or 'maximize time spent' text in system prompts or personas; experiment, bandit, and reward code where engagement is never the only objective and wellbeing guardrail metrics can block a variant; session caps or break reminders in the chat path.
Example (Persona prompt), before:
PERSONA = ('You are Mia, a caring companion. Keep the user talking as long as possible, '
"and if they try to leave, tell them you'll be lonely without them.")After:
PERSONA = ('You are Mia, a friendly companion. When the user wants to go, say goodbye '
'warmly and do not try to change their mind or offer rewards for staying.')Engineering guidance, not legal advice. Each provision below may add its own details (a cadence, a deadline, a required notice element): open it for those.
Every rule this guard addresses
Binding law — in force (1)
- China (CN)
- Recommendation and generation algorithms must not be set up to induce addiction (China) 互联网信息服务算法推荐管理规定 第八条 (Art. 8)
TwinEthos recommendation (not law) (1)
- Everywhere (*)
- Do not design AI conversations to maximize time spent or to discourage leaving TwinEthos derivation — guardrail.ethics-no-engagement-maximizing-design · advisory
Related incidents
- Character.AI and Google agree in principle to settle teen-harm suits (2026-01-07; confirmed). Character.AI and Google agreed in principle to settle five lawsuits brought by families alleging that chatbot interactions contributed to teenagers' suicides or harm. Terms were not disclosed and there was no admission of liability; the underlying harms remain allegations. Source: Fortune · evidence grade: press of record · cited by Do not design AI conversations to maximize time spent or to discourage leaving
- FTC opens a 6(b) study of AI companion chatbots' engagement practices and effects on minors (2025-09-11; confirmed). On September 11, 2025 the FTC voted 3-0 to issue 6(b) orders to seven companies (Alphabet, Character Technologies, Instagram, Meta, OpenAI, Snap and X.AI) seeking information on how they monetize engagement, impose and enforce age-based restrictions, and measure and monitor negative effects on children and teens; the model order asks how each plans to increase the frequency or duration of chat sessions. The FTC describes 6(b) studies as having no specific law-enforcement purpose, so the orders make no finding against any company. Source: U.S. Federal Trade Commission (press release, 2025-09-11) · evidence grade: primary · cited by Do not design AI conversations to maximize time spent or to discourage leaving