AI startup Anthropic has made changes to its policies, allowing minors to use its generative AI systems under certain conditions. In a blog post, the company stated that it will permit teens and preteens to use third-party apps powered by its AI models if developers implement specific safety features and disclose the Anthropic technologies they are utilizing. To ensure the safety of minors, Anthropic recommends including age verification systems, content moderation and filtering, and educational resources on responsible AI use. The company may also provide technical measures to tailor AI experiences for minors. Developers using Anthropic’s AI models must comply with child safety and data privacy regulations such as COPPA. Anthropic plans to periodically audit apps for compliance and take action against those in violation.
Anthropic’s policy change aligns with the growing trend of kids and teens using generative AI tools for academic and personal purposes. Competitors like Google and OpenAI are also exploring use cases aimed at children. OpenAI has formed a team to study child safety and partnered with Common Sense Media to develop kid-friendly AI guidelines. Meanwhile, Google has made its chatbot Bard, now known as Gemini, available to teens in selected regions.
A poll conducted by the Center for Democracy and Technology revealed that 29% of kids have used generative AI tools to address anxiety or mental health issues, 22% for problems with friends, and 16% for family conflicts. However, concerns about the misuse of generative AI persist. Last summer, schools and colleges initially banned generative AI apps due to fears of plagiarism and misinformation. While some have since lifted the bans, skeptics point to surveys like the one conducted by the U.K. Safer Internet Centre, which found that over half of kids have witnessed their peers using generative AI in negative ways, such as creating false information or explicit deepfakes.
With calls for guidelines on the use of generative AI by children increasing, UNESCO has urged governments to regulate its use in education. This includes implementing age limits, safeguarding data protection and user privacy, and engaging the public in decision-making. According to Audrey Azoulay, UNESCO’s director-general, while generative AI presents opportunities for human development, precautions and regulations are necessary to prevent harm and prejudice.