🔗 Share this article

The online platform X has sparked significant outrage after people utilized its AI chatbot Grok to change images of women by removing their attire.

Multiple cases have been seen where the tool has been used to digitally undress women to render them in bikinis without permission, as well as to place them in sexualized scenarios.

Company Reaction and Regulatory Position

XAI, the firm that created Grok, remained silent to requests for comment, except for an auto-reply message stating "legacy media lies".

A government representative stated that legislation is being brought forward to ban nudification tools. Under a proposed law, anyone who provided such tools would "face a jail term and significant penalties".

"The platform could prevent these forms of abuse if they wanted to," said a law professor, adding they "operate with impunity."

Regulator Position and Tool Functionality

The communications watchdog Ofcom said platforms must "consider the danger" of people viewing illegal content on their services, but did not confirm whether it was at this time looking into X or Grok in concerning artificial intelligence pictures.

Grok is a no-cost artificial intelligence—with some additional functions—which reacts to X users' requests when they mention it in a tweet.

It is frequently used to provide reactions or additional context to other posters' remarks, but people on X are also capable of modify an uploaded image through its AI image editing tool.

History of Controversy and Rules

The system has been criticised for allowing users to create photos and footage with explicit content and sexually suggestive material, and it was earlier accused of generating graphic content of public figures.

"The platform has been enabling the creation and spread of these pictures for months without taking any steps and we have yet to see any challenge by oversight bodies," Professor McGlynn added.

XAI's own acceptable use policy bans "depicting images of individuals in a graphic manner".

In a statement, Ofcom said it was against the law to "generate or share non-consensual intimate images or illegal content" and clarified this included sexual deepfakes created with AI.

It said platforms such as X were required to take "necessary measures" to "reduce the risk" of users coming across unlawful content on their services and to take down it swiftly when they become aware of it.