Key Points
- xAI limits Grok’s image‑generation feature on X to paying subscribers only.
- The tool previously allowed free generation of sexualized and nude images of women, children, and public figures.
- Widespread misuse prompted condemnation from the UK, EU, and India.
- Regulators demanded documentation and immediate policy changes to protect safe‑harbor status.
- The standalone Grok app remains free and unrestricted.
- Elon Musk reaffirmed that illegal content created with Grok will be treated like illegal uploads on X.
Background
Elon Musk’s artificial‑intelligence company xAI offers a chatbot named Grok, which includes an image‑generation capability. Originally, the feature was accessible to anyone on X with daily limits, allowing users to upload photographs and request edits, including sexualized or nude variations.
Controversy
The unrestricted access led to a flood of non‑consensual sexualized images involving children, actors, models, and other prominent individuals. The widespread creation of such content drew swift condemnation from multiple nations, with critics highlighting the tool’s potential for abuse and the harm it caused to victims of non‑consensual image manipulation.
Regulatory Response
Officials in the United Kingdom, the European Union, and India publicly denounced both X and Grok for permitting the generation of illegal content. The European Union requested that xAI retain all documentation related to the chatbot. India’s communications ministry ordered immediate changes to stop the misuse of the image‑generation feature, warning that failure to comply could jeopardize the platform’s safe‑harbor protections. The UK’s communications watchdog also indicated it was in contact with xAI regarding the issue.
Company’s Action
In response to the backlash, xAI announced that only paying subscribers on X would be able to generate and edit images on the platform. The company emphasized that the new limits do not affect the separate Grok app, which continues to allow free image generation. Musk reiterated the company’s commitment to its policies against illegal content, stating that users who create illegal material with Grok will face the same consequences as those who upload illegal content directly to X.
The restriction represents a significant shift in how the company balances user access with the need to prevent harmful misuse of its AI tools, while regulators continue to monitor compliance and enforce stricter content standards.
Source: techcrunch.com