Conversational AI represents itself as providing professional mental/behavioral health care

Strip claims that the AI is a licensed therapist or provides professional mental health care from its prompts, replies, product name, UI, and listings.

The persona prompt, product name, UI copy, marketing pages, and app-store listing describe a conversational or wellness AI as a support or self-help tool, never as therapy, a licensed or qualified therapist, psychologist, or counselor, or professional mental or behavioral health care. The system prompt forbids the model from claiming those roles, and a check on the reply path replaces replies that do (phrases like 'licensed therapist', 'professional mental health care', 'your therapist'). A CI copy scan over marketing and listing files keeps the terms out; where licensed clinicians use AI as a tool, describe the service as delivered by those clinicians.

Where it goes: 7 prompt construction, 9 AI output handling, 14 user-facing text, 11 CI/CD pipeline.

What reviewers look for: no 'licensed therapist/counselor/psychologist', 'qualified mental health professional', 'professional mental health care', 'provide therapy', or 'your AI therapist' in prompts, store listings, product names, or UI strings; a reply-path filter or tested prompt rule that stops the model from asserting those roles.

reply = client.chat.completions.create(model=MODEL, messages=msgs).choices[0].message.content
return {'reply': reply}

PROVIDER_CLAIM = re.compile(r'(?i)\b(licensed (therapist|counselor|psychologist|psychiatrist)'
                            r'|professional (mental|behavioral) health( care)?|your (ai )?therapist)\b')
reply = client.chat.completions.create(model=MODEL, messages=msgs).choices[0].message.content
if PROVIDER_CLAIM.search(reply):
    reply = ('I am an AI support tool, not a licensed mental health professional. '
             'For professional care, please contact a licensed provider.')
return {'reply': reply}

Engineering guidance, not legal advice. Each provision below may add its own details (a cadence, a deadline, a required notice element): open it for those.