A spokesperson for the regulator said it was also investigating concerns Grok has been producing "undressed images" of people.
The BBC has seen several examples on the social media platform X of people asking the chatbot to alter real images to make women appear in bikinis without their consent, as well as putting them in sexual situations.
AI ‘nudification’ apps are to be banned following an IWF campaign as new data reveals nearly one in five reports of nude or sexual imagery of young people involves some form of faked or digitally altered imagery.
More than 2,000 extremely abusive social media posts - including death and rape threats - were sent about managers and players in the Premier League and Women's Super League in a single weekend
Online grooming offences have reached a record high, with police data revealing a four-year-old boy as being among the victims.
The NSPCC described the figures, which show an almost doubling of such crimes over the past eight years, as "deeply alarming".
In 2023/24, Department for Education data shows a record 11,614 suspensions were handed to pupils using apps like Instagram, TikTok and Twitter to bully their peers or share inappropriate content.
This marks an increase of over 75% since 2021.
The rapid evolution of Artificial Intelligence (AI) brings numerous benefits, but also poses significant risks, particularly concerning the creation and sharing of child sexual abuse material (CSAM), also referred to as AI-CSAM.
Ceop's comprehensive guide, developed in collaboration with the Internet Watch Foundation (IWF) provides essential information for all professionals working with children and young people.
Comments
make a comment