Binding law — in force
High impact generative AI must prevent CSEM and pro-terror outputs, test and adjust models, warn and refer users (Australia, DIS Standard 2024 s 22(3))
Under Australia's Online Safety (Designated Internet Services - Class 1A and Class 1B Material) Industry Standard 2024 s 22, a provider of a high impact generative AI designated internet service (a service using machine learning models to let end-users produce material, capable of generating synthetic high impact material) must implement systems, processes and technologies that prevent generative AI features from producing child sexual exploitation material or pro-terror material; regularly review and test models for that risk and promptly adjust them and deploy mitigations; present prominent messaging on the risk and criminality to users in Australia seeking child sexual abuse material; accompany material generated from terms associated with it with reporting and support links; and detect child sexual abuse material automatically in training data, user prompts and outputs. Detect an image-generation call with no input or output safety check, or a disabled safety checker.
au-dis-standard.genai-csem-terror-safeguards · DIS Standard s 22(1)-(3) (deter and disrupt CSEM and pro-terror material; further minimum requirements for high impact generative AI DIS) · official source · jurisdictions: AU