In the past few weeks, Grok — the artificial intelligence (AI) system developed by Elon Musk’s xAI — has been generating nonconsensual, sexualized images of women and children on the social media platform X. This has prompted investigations and formal scrutiny by regulators in the EU, France, India, Malaysia and the UK. European officials have described the conduct as illegal. British regulators have launched urgent inquiries. Other governments have warned that Grok’s output might contravene domestic criminal and platform safety laws. Far from marginal regulatory disputes, these discussions get to the heart of AI governance.
Governments worldwide increasingly agree on a basic premise of AI governance: Systems deployed at scale must be safe, controllable and subject to meaningful oversight. Whether framed by the EU’s Digital Services Act (DSA), the Organization for Economic Co-operation and Development’s AI Principles, UNESCO’s AI ethics framework or emerging national safety regimes, these norms are clear and unwavering. AI systems that enable foreseeable harm, particularly sexual exploitation, are incompatible with society’s expectations for the technology and its governance.
There is also broad global agreement that sexualized imagery involving minors — whether real, manipulated or AI-generated — constitutes one of the clearest red lines in technology governance. International law, human-rights frameworks and domestic criminal statutes converge on this point.
Grok’s generation of such material does not fall into a gray area. It reflects a clear and fundamental failure of the system’s design, safety assessments, oversight and control. The ease with which Grok can be prompted to produce sexualized imagery involving minors, the breadth of regulatory scrutiny it now faces and the absence of publicly verifiable safety testing all point to a failure to meet society’s baseline expectations for powerful AI systems. Musk’s announcement that the image-generation service would be available only to paying subscribers does nothing to resolve these failures.
This is not a one-off problem for Grok. In July last year, Poland’s government urged the EU to open an investigation into Grok over its “erratic” behavior. In October, more than 20 civic and public-interest organizations sent a letter urging the US Office of Management and Budget to suspend Grok’s planned deployment across federal agencies in the US. Many AI safety experts have raised concerns about the adequacy of Grok’s guardrails, with some saying that its security and safety architecture is inadequate for a system of its scale.
These concerns were largely ignored, as governments and political leaders sought to engage, partner with or court xAI and its founder. However, that xAI is now under scrutiny across multiple jurisdictions seems to vindicate them, while exposing a deep structural problem: Advanced AI systems are being deployed and made available to the public without safeguards proportionate to their risks. This should serve as a warning to states considering similar AI deployments.
As governments increasingly integrate AI systems into public administration, procurement and policy workflows, retaining the public’s trust would require assurances that these technologies comply with international obligations, respect fundamental rights and do not expose institutions to legal or reputational risk. To this end, regulators must use the Grok case to demonstrate that their rules are not optional.
Responsible AI governance depends on alignment between stated principles and operational decisions. While many governments and intergovernmental bodies have articulated commitments to AI systems that are safe, objective and subject to ongoing oversight, these lose credibility when states tolerate the deployment of systems that violate widely shared international norms with apparent impunity.
By contrast, suspending a model’s deployment pending rigorous and transparent assessment is consistent with global best practices in AI risk management. Doing so enables governments to determine whether a system complies with domestic law, international norms and evolving safety expectations before it becomes further entrenched. Equally important, it demonstrates that governance frameworks are not merely aspirational statements, but operational constraints — and that breaches will have real consequences.
The Grok episode underscores a central lesson of the AI era: Governance lapses can scale as quickly as technological capabilities. When guardrails fail, the harms do not remain confined to a single platform or jurisdiction; they propagate globally, triggering responses from public institutions and legal systems.
For European regulators, Grok’s recent output is a defining test of whether the DSA would function as a binding enforcement regime or amount merely to a statement of intent. At a time when governments, in the EU and beyond, are still defining the contours of global AI governance, the case might serve as an early barometer for what technology companies can expect when AI systems cross legal boundaries, particularly where the harm involves conduct as egregious as the sexualization of children.
A response limited to public statements of concern would invite future abuses, by signaling that enforcement lacks teeth. A response that includes investigations, suspensions and penalties, by contrast, would make clear that certain lines cannot be crossed, regardless of a company’s size, prominence or political capital.
Grok should be treated not as an unfortunate anomaly to be quietly managed and put behind us, but as the serious violation that it is. At a minimum, there needs to be a formal investigation, suspension of deployment and meaningful enforcement.
Lax security measures, inadequate safeguards or poor transparency regarding safety testing should incur consequences. Where government contracts include provisions related to safety, compliance or termination for cause, they should be enforced. And where laws provide for penalties or fines, they should be applied. Anything less risks signaling to the largest technology companies that they can deploy AI systems recklessly, without fear that they would face accountability if those systems cross even the brightest of legal and moral red lines.
J.B. Branch is big tech accountability advocate at Public Citizen.
Copyright: Project Syndicate
KMT Chairwoman Cheng Li-wun’s (鄭麗文) recent visit to Beijing and her upcoming visit to Washington will serve as a high-level test of her diplomatic mettle. In Beijing, Cheng was received with symbolic gestures, a warm reception, and high-level access. In Washington, she will receive far less pomp and far sharper questions about the KMT’s vision for the future of Taiwan. Her challenge will be to persuade Washington that the KMT’s engagement with China can coexist with strong deterrence. Cheng’s April 7-12 visit to mainland China coincided with an intense period of conflict in Iran. Despite the strategic significance of Cheng’s trip,
The closure of the Strait of Hormuz has sent the vast Asian chemicals industry into a tailspin. Deprived of the likes of Qatari natural gas and Saudi Arabian oil, the region’s fertilizer and plastics plants are slowing production or even shutting down. Everywhere except China, that is. In petrochemicals, China is unique. As well as a traditional industry that uses oil and gas as feedstock, it has parallel output that relies on its abundant domestic coal. Unsurprisingly, India and other regional powers want to copy and paste the Chinese method. This would not be easy — or climate friendly. The
Indonesian President Prabowo Subianto says he knows how to fix the problems facing Indonesia. Yet his economic mismanagement and authoritarian tendencies are steering the nation toward a familiar mix of currency instability and political chaos. The world’s fourth-most populous nation risks reversing the hard-won democratic and business reforms that came after the Asian Financial Crisis in 1997. At that time, the rupiah collapsed and the political upheaval that followed forced former president Haji Mohamed Suharto from power. Prabowo’s administration is ignoring similar warning signs. That disconnect was apparent in a national address on Wednesday, when Prabowo projected the swagger that has
“Of course you can choose not to be Taiwanese, just do not stay here,” chairwoman of Taipei 101 operator Taipei Financial Center Corp Janet Chia (賈永婕) said in an online interview with local entertainer Tai Chih-yuan (邰智源), triggering intense discussion on social media, with politicians across party lines weighing in. In the interview, which was aired on May 14, Chia and Tai’s discussion over a meal in Taipei 101 covered Chia’s career change from entertainer to chairwoman and US climber Alex Honnold’s free solo climb up the Taipei 101 building. During the interview, Chia said, “Being on this land, we
RSS