A spokesperson for the regulator said it was also investigating concerns Grok has been producing "undressed images" of people.
The BBC has seen several examples on the social media platform X of people asking the chatbot to alter real images to make women appear in bikinis without their consent, as well as putting them in sexual situations.
AI ‘nudification’ apps are to be banned following an IWF campaign as new data reveals nearly one in five reports of nude or sexual imagery of young people involves some form of faked or digitally altered imagery.
More than 2,000 extremely abusive social media posts - including death and rape threats - were sent about managers and players in the Premier League and Women's Super League in a single weekend
Ofcom has already published final Codes and risk assessment guidance on how we expect platforms to tackle illegal content and content harmful to children. Ofcom’s role is to hold tech companies to account and ensure they comply with the law, using our enforcement powers where necessary.
But Ofcom is also required to produce guidance setting out how providers can take action against harmful content and activity that disproportionately affects women and girls, in recognition of the unique risks they face.
Ofcom has today issued a £50,000 fine against the provider of a nudification site for failing to use age-checks to protect children from online pornography, while 20 more porn services are targeted for enforcement.
Robust age checks – which include age verification, age estimation or a combination of both - are a cornerstone of the Online Safety Act and must be ‘highly effective’ at correctly determining whether a particular user is a child.
Online grooming offences have reached a record high, with police data revealing a four-year-old boy as being among the victims.
The NSPCC described the figures, which show an almost doubling of such crimes over the past eight years, as "deeply alarming".
Comments
make a comment