The online network X has provoked significant anger after users utilized its AI chatbot Grok to change photos of females by taking off their garments.
Numerous examples have emerged where the tool has been used to digitally undress female subjects to make them appear in bikinis non-consensually, as well as to insert them in sexualized contexts.
Developer Reaction and Legal Stance
XAI, the firm behind Grok, remained silent to requests for comment, except for an standard message stating "legacy media lies".
A Home Office official stated that legislation is being proposed to outlaw nudification technology. Under a new criminal offence, anyone who supplied such tools would "receive a jail term and heavy penalties".
"X or Grok is capable of halting these types of misuse if they wanted to," said a law professor, adding they "seem to have impunity."
Regulator Position and Tool Capabilities
The regulator Ofcom said platforms must "evaluate the potential" of people viewing illegal content on their platforms, but did not confirm whether it was at this time examining X or Grok in regarding AI-generated pictures.
Grok is a free chatbot—with some paid-for features—which responds to X users' prompts when they mention it in a post.
It is frequently used to provide commentary or more context to other posters' remarks, but people on X are also can modify an uploaded image through its artificial intelligence picture modification tool.
Background of Criticism and Rules
The tool has been condemned for allowing users to generate photos and clips with explicit content and sexually suggestive content, and it was earlier accused of creating graphic material of public figures.
"The platform has been permitting the creation and distribution of these images for months without taking any action and we have yet to see any action by regulators," the expert added.
XAI's own usage rules bans "showing images of individuals in a sexually explicit manner".
In a comment, Ofcom said it was illegal to "generate or share deepfakes or child sexual abuse material" and confirmed this covered sexual deepfakes made with AI.
It said platforms such as X were obligated to take "suitable steps" to "reduce the danger" of users coming across unlawful material on their services and to remove it promptly when they learn of it.
