Binding law — in force
AI companions must detect suicidal ideation and self-harm and refer users to crisis services (New York)
New York makes it unlawful to operate or provide an AI companion to a user in the state unless it contains a protocol that makes reasonable efforts to detect a user's expressions of suicidal ideation or self-harm and, on detection, notifies the user with a referral to crisis services such as the 988 hotline or a crisis text line. Unlike California SB 243, the statute does not require publishing the protocol. Detect an AI-companion conversation path where user messages reach the model with no self-harm detection, or a detection that does not produce a crisis referral to the user.
ny-gbl-art47.companion-crisis-protocol · N.Y. Gen. Bus. Law 1701 · official source · jurisdictions: US-NY