New York State Governor Kathy Hochul on Wednesday signed a law that prohibits minors from interacting with AI companions. The text also requires chatbot operators to verify the age of their users and block certain behaviors when it is established that an internet user is a minor.
The adopted definition applies, according to the text, to most generative artificial intelligence chatbots on the market. Several states have already passed laws regulating the use of an AI companion by a minor, such as California, but none had defined a scope of application as broad.
Concretely, a chatbot cannot produce content suggesting it is “human,” living, or that it feels human emotions, the law specifies. It must not present its exchanges with the young user as a “personal” or “professional relationship,” nor take on “a role of authority.” The text it generates must also not be presented as a “personal opinion,” and it is prohibited from asking questions about the user’s feelings and psychological state.
A Law with “Vague Language”
Tech”: “NYC”, the representative body for New York’s technology sector, criticized the text. The organization points in particular to its “vague language,” which “raises serious questions” regarding the First Amendment of the U.S. Constitution, relating to freedom of speech.
“Ensuring children’s safety online should not involve cutting them off from learning tools and career preparation,” argued Tech:NYC. According to the organization, the text “could restrict access to tutoring, homework help, programming assistants, and platforms essential for career prospects, while increasing the risks of exploitation of children’s data.”
Contacted by AFP, Anthropic and Google did not respond immediately. OpenAI referred to Tech:NYC’s reaction.
Conversely, Common Sense Media, an association dedicated to informing parents about media and technology products aimed at young audiences, welcomed what it calls “the strongest child AI safety law in the country.” “New York made history” with this text, insisted Jim Steyer, the director of this organization, which is also dedicated to protecting minors from the negative effects of technology.
