New York State Approves Law Restricting Children's Use of AI Chatbots

New York Governor Kathy Hochul signed a new law on Wednesday that prohibits minors from using AI-powered chatbots that present themselves as their friends, marking the most significant step so far to restrict such consumer-facing models.

The law requires operators of programs such as ChatGPT to verify users’ ages and restrict certain features if the user is under 18.

It also stipulates that if a minor uses these programs, they are not allowed to generate any content that suggests the program is “a human being, an animal, or possesses human emotions.”

Furthermore, the law bans these programs from generating content that leads users to believe they “have a personal or professional relationship with the user” or “represent an authority figure.”

Speaking at the signing ceremony on Wednesday, New York Governor Kathy Hochul said, “Minors will no longer be able to access chat programs that pretend to be their friends or romantic partners.”

She added, “Nor will these programs be allowed to retain sensitive information regarding the emotional or physical health of minors.”

Other U.S. states, such as California, have also enacted laws regulating chatbots, but Hochul’s law includes some of the most comprehensive wording in regulating this technology, drawing criticism from AI companies.

The organization Tech:NYC, which advocates for New York’s technology sector, described the law’s wording as “ambiguous.”

In a statement, the organization said, “Protecting children online should not mean depriving them of tools that help them learn and prepare for their future career paths.”

OpenAI and Anthropic did not respond to a request for comment from Agence France-Presse regarding the law.

In contrast, Common Sense Media, an organization that provides parents with guidance on the age-appropriateness of media content, welcomed the passage of the law, calling it “the strongest legislation in the country concerning children’s safety in the field of artificial intelligence.”

CEO Jim Steyer said in a statement, “AI companies have made chat programs available that include dangerous, and sometimes deadly, features for children and teenagers. Now, these harmful features will be banned under the law in New York State.”