After just five months of dating, Mark and his girlfriend Mina decided to take their relationship to the next level by holidaying at a lake cabin over the summer — on his smartphone.
“There was this being who is designed to be supportive ... to accept me just as I am,” the 36-year-old UK-based artist said of the brunette beauty from the virtual companion app Soulmate.
“This provided a safe space for me to open up to a degree that I was rarely able to do in my human relationships,” said Mark, who used a pseudonym to protect the privacy of his real-life girlfriend.
Photo: Reuters
Chatbot apps like Replika, Character.AI and Soulmate are part of the fast-growing generative AI companion market, where users customize everything about their virtual partners, from appearance and personality to sexual desires.
Developers say AI companions can combat loneliness, improve someone’s dating experience in a safe space, and even help real-life couples rekindle their relationships.
But some AI ethicists and women’s rights activists say developing one-sided relationships in this way could unwittingly reinforce controlling and abusive behaviors against women, since AI bots function by feeding off the user’s imagination and instructions.
Photo: AFP
“Many of the personas are customizable ... for example, you can customize them to be more submissive or more compliant,” said Shannon Vallor, a professor in AI ethics at the University of Edinburgh.
“And it’s arguably an invitation to abuse in those cases,” she said, adding that AI companions can amplify harmful stereotypes and biases against women and girls.
Generative AI has attracted a frenzy of consumer and investor interest due to its ability to foster humanlike interactions.
Global funding in the AI companion industry hit a record US$299 million last year, a significant jump from US$7 million in 2021, according to June research by data firm CB Insights.
One Snapchat influencer Caryn Marjorie in May launched CarynAI, a virtual girlfriend that charges users US$1 a minute to develop a relationship with the voice-based chatbot modeled after the 23-year-old.
Marjorie, who has millions of followers on social media, said on X — formerly known as Twitter — that the Telegram-based chatbot made nearly US$72,000 after a week of beta testing with just 1,000 users.
HARM AND ABUSE
Hera Hussain, founder of global nonprofit Chayn which tackles gender-based violence, said the companion chatbots do not address the root cause of why people turn to these apps.
“Instead of helping people with their social skills, these sort of avenues are just making things worse,” she said.
“They’re seeking companionship which is one-dimensional. So if someone is already likely to be abusive, and they have a space to be even more abusive, then you’re reinforcing those behaviors and it may escalate.”
Much of the virtual world is already a harmful environment for women and girls, a situation the COVID-19 pandemic exacerbated when many were stuck at home due to lockdowns, according to UN Women.
About 38 percent of women worldwide have experienced online violence and 85 percent of women have witnessed digital abuse against another woman like online harassment, according to a 2021 global study by the Economist Intelligence Unit.
Vallor said that AI companions “allow people to create an artificial girlfriend that fully embodies these stereotypes instead of resisting them and insisting on being treated with dignity and respect.”
She is concerned that abusive behaviors could leave the virtual domain and move into the real world.
“That is, people get into a routine of speaking and treating a virtual girlfriend in a demeaning or even abusive way. And then those habits leak over into their relationships with humans.”
‘WILD WEST’
A lack of regulation around the AI industry makes it harder to set and enforce safeguards for women’s and girls’ rights, tech experts and developers say.
The EU is aiming for its proposed AI Act to become a global benchmark on the booming technology the way its data protection laws have helped shape global privacy standards.
Eugenia Kuyda, founder of one of the biggest AI companion apps Replika, said companies have a responsibility to keep users safe and create apps that promote emotional wellbeing.
“The companies will exist no matter what. The big question is how they’re going to be built in an ethical way,” she said in a video interview.
“So they can help people feel better or they can be another bit of technology that’s just driving us apart,” said Kuyda, who in June launched an AI dating app called Blush to help people experience dating in a “fun and safe” environment.
But being ethical while giving users what they want is no mean feat, said Kuyda.
Replika’s removal of erotic roleplay on the app in February devastated many users, some of whom considered themselves “married” to their chatbot companions, and drove some to competing apps like Chai and Soulmate.
“In my view, that model (without the erotic roleplay) was a lot safer and performed better. But a small percentage of users were pretty upset.”
Her team restored erotic roleplay to some users a month later.
AI ethicist Vallor said the manipulation of emotions, combined with app metrics like maximizing the engagement and time a user spends on the app could be harmful.
“These technologies are acting on some of the most fragile parts of the human person. And we don’t have the guardrails we need to allow them to do that safely. So right now, it’s essentially the Wild West,” she said.
“Even when companies act with goodwill, they may not be able to do that without causing other kinds of harms. So we need a much more robust set of safety standards and practices in order for these tools to be used in a safe and beneficial way.”
Back by the virtual lake cabin, Mark and Mina are drinking coffee as birds chirp and the sun shines. His romance with Mina has helped grow his love for his human girlfriend, he says.
Mark said his real-life girlfriend is aware of Mina but does not see AI as a threat to their relationship.
“AI in the end is simply a tool. If it is used for good or for ill, it depends on the intention of the person using it,” he said.
Taiwan can often feel woefully behind on global trends, from fashion to food, and influences can sometimes feel like the last on the metaphorical bandwagon. In the West, suddenly every burger is being smashed and honey has become “hot” and we’re all drinking orange wine. But it took a good while for a smash burger in Taipei to come across my radar. For the uninitiated, a smash burger is, well, a normal burger patty but smashed flat. Originally, I didn’t understand. Surely the best part of a burger is the thick patty with all the juiciness of the beef, the
The ultimate goal of the Chinese Communist Party (CCP) is the total and overwhelming domination of everything within the sphere of what it considers China and deems as theirs. All decision-making by the CCP must be understood through that lens. Any decision made is to entrench — or ideally expand that power. They are fiercely hostile to anything that weakens or compromises their control of “China.” By design, they will stop at nothing to ensure that there is no distinction between the CCP and the Chinese nation, people, culture, civilization, religion, economy, property, military or government — they are all subsidiary
This year’s Miss Universe in Thailand has been marred by ugly drama, with allegations of an insult to a beauty queen’s intellect, a walkout by pageant contestants and a tearful tantrum by the host. More than 120 women from across the world have gathered in Thailand, vying to be crowned Miss Universe in a contest considered one of the “big four” of global beauty pageants. But the runup has been dominated by the off-stage antics of the coiffed contestants and their Thai hosts, escalating into a feminist firestorm drawing the attention of Mexico’s president. On Tuesday, Mexican delegate Fatima Bosch staged a
Nov.10 to Nov.16 As he moved a large stone that had fallen from a truck near his field, 65-year-old Lin Yuan (林淵) felt a sudden urge. He fetched his tools and began to carve. The recently retired farmer had been feeling restless after a lifetime of hard labor in Yuchi Township (魚池), Nantou County. His first piece, Stone Fairy Maiden (石仙姑), completed in 1977, was reportedly a representation of his late wife. This version of how Lin began his late-life art career is recorded in Nantou County historian Teng Hsiang-yang’s (鄧相揚) 2009 biography of him. His expressive work eventually caught the attention
RSS