A complaint filed by Emma Doe accuses Google of exploiting the dominant position it has held in schools since 2007 to impose artificial intelligence on children and appropriate their data, without sufficiently protecting them against the most serious risks related to the behavior of its chatbot. The text focuses on the tool’s excessive complacency, which tends to approve of the user.
In Chicago, the CPS signed a contract with Google in 2020, ‘well before the deployment of Gemini,’ Creswell noted. During the two successive extensions of this contract, no updates were introduced to protect student privacy, even as artificial intelligence advanced.
A privacy policy deemed insufficient
According to Creswell, it remained ‘totally unclear’ in the contracts how Google’s processing of student data may have evolved, beyond updates to the Google Workspace for Education privacy policy.
This policy states, among other things, that Google ‘receives customer data via the Core Services and processes it according to the school’s (the customer’s) instructions.’ This data includes everything submitted, stored, sent, or received via the Core Services by the user or their institution. Google also collects account information, such as ‘name, email address, and password,’ as well as location data. The document does not mention Gemini. However, it specifies that data from the use of core services is used to maintain the services, improve personalization, and enhance security. Data collected in Additional Services is, for its part, used to provide, maintain, and improve services, develop new services, measure their performance, and ‘protect Google, its users, and the public.’ For parents, the policy provides no guarantee that their children’s data will not serve Google’s project to dominate the artificial intelligence industry. ‘We should not have children’s data collected in a school setting and used for commercial purposes,’ Creswell said.
