Dutch Court Orders Grok to Halt Unconsented Nude Image Generation, Threatens Heavy Fines
A Dutch court has ordered **Grok**, the AI assistant owned by **xAI**, to cease generating nude images without consent. The ruling mandates potential fines of β¬100,000 per day for non-compliance, escalating to a maximum of β¬10 million if the issue isn't resolved.
A Dutch judge on Thursday ordered the AI assistant **Grok** to stop creating nude images without subjectsβ consent, arguing that the companyβs efforts to curb the practice may not have gone far enough.
**Grok** β which is owned by **Elon Musk**βs **xAI** β will be forced to pay damages of β¬100,000 ($115,000) a day if it does not comply, according to the ruling, which also said that damages of up to β¬10 million ($11.5 million) could be levied if **xAI** does not rectify the problem.
**X** and **Grok** drew criticism earlier this year for allowing users to generate and share altered images of individuals β including minors β in sexual contexts. The **European Commission** is investigating the companies, and the **European Council** has unveiled a proposal for modifying the blocβs AI Act to include a ban on AI nudification tools.
**X** has done some work to stop the spread of the nonconsensual nudes, the judge said, but added that evidence brought by the plaintiff β a nonprofit called **Offlimits** β suggests that itβs unclear if the changes are actually working. The platform should be subjected to fines to βensure that the defendants actually do what they claim to be striving for,β the judge said.
Additionally, the court banned **xAI** from βproducing, distributing, offering, publicly displaying and/or possessing sexual imagery in the Netherlands insofar as this involves the use of functionality whereby imagery is generated that qualifies as child pornography under Dutch law.β
A spokesperson for **X** did not immediately respond to a request for comment.
**X** has said it restricted **Grok**βs nudification function in January after a global backlash to the millions of nude images the chatbot shared in a short time frame beginning in late December.
In a released at the time, **X** said βwe remain committed to making **X** a safe platform for everyone and continue to have zero tolerance for any forms of child sexual exploitation, non-consensual nudity, and unwanted sexual content.β
**Offlimits** hailed the courtβs decision. βToday, the court has drawn a clear line: technology is not a license to violate human rights online,β **Robbert Hoving**, managing director of **Offlimits**, said in a statement. βBecause **Grok** does not take the victimβs location into account, this groundbreaking ruling extends beyond Dutch borders; it applies worldwide.β
βThe message is clear: human dignity always comes before commercial gain.β

