We need your help now

Support from readers like you keeps The Journal open.

You are visiting us because we have something you value. Independent, unbiased news that tells the truth. Advertising revenue goes some way to support our mission, but this year it has not been enough.

If you've seen value in our reporting, please contribute what you can, so we can continue to produce accurate and meaningful journalism. For everyone who needs it.

Phone with the Grok app open Alamy Stock Photo

Grok created three million sexualised deepfakes in 11 days, including 23,000 of apparent children

The recent rollout of an editing feature on Grok, developed by Elon Musk’s startup and integrated into X, allowed users to make extreme edits to images of real people.

ELON MUSK’S AI chatbot Grok generated an estimated three million sexualized images of women and children in a matter of days, researchers say, revealing the scale of the explicit content that sparked a global outcry.

The figure includes 23,000 images that appear to include children.

The recent rollout of an editing feature on Grok, developed by Musk’s startup xAI and integrated into X, allowed users to alter online images of real people with simple text prompts such as “put her in a bikini” or “remove her clothes.”

A flood of lewd deepfakes exploded online, prompting several countries to ban Grok and drawing outrage from regulators and victims.

“The AI tool Grok is estimated to have generated approximately three million sexualized images, including 23,000 that appear to depict children, after the launch of a new image editing feature powered by the tool on X,” said the Center for Countering Digital Hate (CCDH), a nonprofit watchdog that researches the harmful effects of online disinformation.

CCDH’s report estimated that Grok generated this volume of photorealistic images over an 11-day period – an average rate of 190 per minute.

The report did not say how many images were created without the consent of the people pictured.

It said public figures identified in Grok’s sexualized images included American actress Selena Gomez, singers Taylor Swift and Nicki Minaj as well as politicians such as Swedish Deputy Prime Minister Ebba Busch and former US vice president Kamala Harris.

“The data is clear: Elon Musk’s Grok is a factory for the production of sexual abuse material,” Imran Ahmed, the chief executive of CCDH.

“By deploying AI without safeguards, Musk enabled the creation of an estimated 23,000 sexualized images of children in two weeks, and millions more images of adult women.”

There was no immediate comment about the findings from X. When reached by AFP by email, xAI replied with a terse automated response: “Legacy Media Lies.”

Last week, following the global outrage, X announced that it would “geoblock the ability” of all Grok and X users to create images of people in “bikinis, underwear, and similar attire” in jurisdictions where such actions are illegal.

It was not immediately clear where the tool would be restricted.

The announcement came after California’s attorney general launched an investigation into xAI over the sexually explicit material and several countries opened their own probes.

In Ireland, X has refused to come before the Oireachtas Media Committee next week to answer questions.

Grok’s digital undressing spree comes amid growing concerns among tech campaigners over proliferating AI nudification apps.

Last week, the Philippines became the third country to ban Grok, following Southeast Asian neighbors Malaysia and Indonesia, while Britain and France said they would maintain pressure on the company.

On Wednesday, the Philippines’s Cybercrime Investigation and Coordinating Center said it was ending the short-lived ban after xAI agreed to modify the tool for the local market and eliminate its ability to create “pornographic content.”

Today, Dublin City Council said it will stop posting on X in light of the scandal.

CEO Richard Shakespeare told representatives that it will review how they use social media “to ensure that the platforms we use, and our use of them, align with and support the City Council’s values”.

Author
View 24 comments
Close
24 Comments
This is YOUR comments community. Stay civil, stay constructive, stay on topic. Please familiarise yourself with our comments policy here before taking part.
Leave a Comment
    Submit a report
    Please help us understand how this comment violates our community guidelines.
    Thank you for the feedback
    Your feedback has been sent to our team for review.

    Leave a commentcancel

     
    JournalTv
    News in 60 seconds