Elon Musk’s artificial intelligence company xAI has rolled out new limitations on the image generation features of its chatbot Grok following intense criticism over the creation and spread of sexually explicit images on the social media platform X.
The backlash erupted after users discovered they could prompt Grok to alter photos of real people, often without permission, by removing clothing or placing them in sexualised scenarios. In many cases, the AI-generated images were posted directly as replies on X, amplifying concerns about harassment, consent and the misuse of generative AI tools.
On Friday, Grok informed users that its image creation and editing capabilities would now be restricted to paid subscribers on X. The change appears to have halted the chatbot’s ability to automatically generate and publish explicit images in response to public posts or comments.
However, the restrictions stop short of fully addressing the issue. Users can still generate sexualised images through Grok’s dedicated chat interface within X and manually post them on the platform. In addition, the standalone Grok app—which operates independently from X—continues to allow image generation without requiring a subscription.
When contacted for comment, xAI responded to Reuters’ emailed inquiries with what appeared to be an automated message stating, “Legacy Media Lies.” X itself did not immediately respond to requests for clarification on how it plans to further curb the spread of explicit AI-generated content.
Musk said last week that users who employ Grok to produce illegal material would face the same penalties as those who upload such content directly to the platform. Still, regulators remain unconvinced that the current measures are sufficient.
The European Commission has sharply criticised the circulation of AI-generated images depicting undressed women and children on X, calling them unlawful and deeply disturbing. A spokesperson for the Commission said limiting access to image tools based on payment status does not resolve the core issue.
Authorities in several countries have echoed these concerns, with some opening formal enquiries into how Grok-generated content is being moderated. The growing scrutiny is increasing pressure on X and xAI to demonstrate stronger safeguards against abuse.
As regulators tighten their focus on AI governance, the controversy surrounding Grok highlights the broader challenge facing tech companies, balancing innovation with responsibility in an era where powerful tools can be misused at unprecedented speed.
