Indonesia and Malaysia have become the first countries to block Grok, the artificial intelligence (AI) chatbot developed by Elon Musk’s xAI, after authorities said it was being misused to generate sexually explicit and nonconsensual images.
The moves reflect growing global concern over generative AI tools that can produce realistic images, sound and text, while existing safeguards fail to prevent their abuse. The Grok chatbot, which is accessed through Musk’s social media platform X, has been criticized for generating manipulated images, including depictions of women in bikinis or sexually explicit poses, as well as images involving children.
Regulators in the two Southeast Asian nations said existing controls were not preventing the creation and spread of fake pornographic content, particularly involving women and minors. Indonesia’s government temporarily blocked access to Grok on Saturday, followed by Malaysia on Sunday.
Photo: AP
“The government sees nonconsensual sexual deepfakes as a serious violation of human rights, dignity and the safety of citizens in the digital space,” Indonesian Minister of Communication and Digital Affairs Meutya Hafid said in a statement on Saturday.
The ministry said the measure was intended to protect women, children and the broader community from fake pornographic content generated using AI.
Initial findings showed that Grok lacks effective safeguards to stop users from creating and distributing pornographic content based on real photos of Indonesian residents, Indonesian Director-General of Digital Space Supervision Alexander Sabar said in a separate statement.
He said such practices risk violating privacy and image rights when photos are manipulated or shared without consent, causing psychological, social and reputational harm.
In Kuala Lumpur, the Malaysian Communications and Multimedia Commission ordered a temporary restriction on Grok on Sunday after what it said was “repeated misuse” of the tool to generate obscene, sexually explicit and nonconsensual manipulated images, including content involving women and minors.
The regulator said notices issued this month to X Corp and xAI demanding stronger safeguards drew responses that relied mainly on user reporting mechanisms.
“The restriction is imposed as a preventive and proportionate measure while legal and regulatory processes are ongoing,” it said, adding that access would remain blocked until effective safeguards are put in place.
Launched in 2023, Grok is free to use on X. Users can ask it questions on the social media platform and tag posts they have directly created or replies to posts from other users. Last summer, the company added an image generator feature, Grok Imagine, that included a so-called “spicy mode” that can generate adult content.
The Southeast Asian restrictions come amid mounting scrutiny of Grok elsewhere, including in the EU, Britain, India and France.
Grok last week limited image generation and editing to paying users following a global backlash over sexualized deepfakes of people, but critics say it did not fully address the problem.
Auschwitz survivor Eva Schloss, the stepsister of teenage diarist Anne Frank and a tireless educator about the horrors of the Holocaust, has died. She was 96. The Anne Frank Trust UK, of which Schloss was honorary president, said she died on Saturday in London, where she lived. Britain’s King Charles III said he was “privileged and proud” to have known Schloss, who cofounded the charitable trust to help young people challenge prejudice. “The horrors that she endured as a young woman are impossible to comprehend and yet she devoted the rest of her life to overcoming hatred and prejudice, promoting kindness, courage, understanding
Tens of thousands of Filipino Catholics yesterday twirled white cloths and chanted “Viva, viva,” as a centuries-old statue of Jesus Christ was paraded through the streets of Manila in the nation’s biggest annual religious event. The day-long procession began before dawn, with barefoot volunteers pulling the heavy carriage through narrow streets where the devout waited in hopes of touching the icon, believed to hold miraculous powers. Thousands of police were deployed to manage crowds that officials believe could number in the millions by the time the statue reaches its home in central Manila’s Quiapo church around midnight. More than 800 people had sought
DENIAL: Pyongyang said a South Korean drone filmed unspecified areas in a North Korean border town, but Seoul said it did not operate drones on the dates it cited North Korea’s military accused South Korea of flying drones across the border between the nations this week, yesterday warning that the South would face consequences for its “unpardonable hysteria.” Seoul quickly denied the accusation, but the development is likely to further dim prospects for its efforts to restore ties with Pyongyang. North Korean forces used special electronic warfare assets on Sunday to bring down a South Korean drone flying over North Korea’s border town. The drone was equipped with two cameras that filmed unspecified areas, the General Staff of the North Korean People’s Army said in a statement. South Korea infiltrated another drone
Cambodia’s government on Wednesday said that it had arrested and extradited to China a tycoon who has been accused of running a huge online scam operation. The Cambodian Ministry of the Interior said that Prince Holding Group chairman Chen Zhi (陳志) and two other Chinese citizens were arrested and extradited on Tuesday at the request of Chinese authorities. Chen formerly had dual nationality, but his Cambodian citizenship was revoked last month, the ministry said. US prosecutors in October last year brought conspiracy charges against Chen, alleging that he had been the mastermind behind a multinational cyberfraud network, used his other businesses to launder