Mental health counselor Nicole Doyle was stunned when the head of the US National Eating Disorders Association showed up at a staff meeting to announce the group would be replacing its helpline with a chatbot.
A few days after the helpline was taken down, the bot — named Tessa — would also be discontinued for providing harmful advice to people in the throes of mental illness.
“People ... found it was giving out weight loss advice to people who told it they were struggling with an eating disorder,” said Doyle, 33, one of five workers who were let go in March, about a year after the chatbot was launched.
Photo: AP
“While Tessa might simulate empathy, it’s not the same as real human empathy,” said Doyle.
The National Eating Disorders Association (NEDA) said that while the research behind the bot produced positive results, they are determining what happened with the advice given and “carefully considering” next steps.
NEDA did not respond directly to questions about the counsellors’ redundancies but said in emailed comments the chatbot was never meant to replace the helpline.
Photo: Reuters
From the US to South Africa, mental health chatbots using artificial intelligence are growing in popularity as health resources are stretched, despite concerns from tech experts around data privacy and counseling ethics.
While digital mental health tools have existed for well over a decade, there are now more than 40 mental health chatbots globally, according to the International Journal of Medical Informatics.
New York-based anthropology student Jonah has turned to a dozen different psychiatric medication and helplines to help him cope with his obsessive compulsive disorder (OCD) over the years.
He has now added ChatGPT to his list of support services as a supplement to his weekly consultations with a therapist.
Jonah had thought about talking to a machine before ChatGPT, because “there’s already a thriving ecosystem of venting into the void online on Twitter or Discord ... it just kind of seemed obvious”, he said.
Although the 22-year-old, who asked to use a pseudonym, described ChatGPT as giving “boilerplate advice”, he said it is still useful “if you’re really worked up and just need to hear something basic ... rather than just worrying alone.”
Mental health tech startups raised US$1.6 billion in venture capital as of December 2020, when COVID-19 put a spotlight on mental health, according to data firm PitchBook.
“The need for distant medical assistance has been highlighted even more by the COVID pandemic,” said Johan Steyn, an AI researcher and founder of AIforBusiness.net, an AI education and management consultancy.
An estimated one billion people worldwide were living with anxiety and depression pre-COVID — 82 percent of them in low and middle-income countries, according to the WHO.
The pandemic increased that number by about 27 percent, the WHO estimates.
Mental health treatment is also divided along income lines, with cost a major barrier to access.
Researchers warn that while the affordability of AI therapy can be alluring, tech companies must be wary of enforcing health care disparities.
People without internet access run the risk of being left behind, or patients with health insurance might access in-person therapy visits while those without are left with the cheaper chatbot option, according to the Brookings Institution.
PRIVACY AND PROTECTION
Despite the growth in popularity of chatbots for mental health support worldwide, privacy concerns are still a major risk for users, the Mozilla Foundation found in research published in May 2022.
Of 32 mental health and prayer apps, like Talkspace, Woebot and Calm, analysed by the tech non-profit, 28 were flagged for “strong concerns over user data management,” and 25 failed to meet security standards like requiring strong passwords.
Mozilla researcher Misha Rykov described the apps as “data-sucking machines with a mental health app veneer”, that open up the possibility of users’ data being collected by insurance and data brokers and social media companies. For example, mental health Woebot was highlighted in the research for “sharing personal information with third parties.”
Woebot says that while it promotes the app using targeted Facebook ads, “no personal data is shared or sold to these marketing/advertising partners,” and that it gives users the option of deleting all their data upon request.
The Mozilla Foundation has since reviewed its assessment in April, saying on its Web site that “after we published our review, Woebot reached out to us and open up a conversation to address our concerns.”
“The result of those conversations were updates to their privacy policy that better clarify how they protect their users’ privacy. So now ... we feel pretty good about Woebot’s privacy.”
AI experts have warned against virtual therapy companies losing sensitive data to cyber breaches.
“AI chatbots face the same privacy risk as more traditional chatbots or any online service that accept personal information from a user,” said Eliot Bendinelli, a senior technologist at rights group Privacy International.
In South Africa, mental health app Panda is due to launch an AI-generated “digital companion” to chat with users, provide suggestions on treatment and, with users’ consent, give scores and insights about users to traditional therapists also accessible on the app.
“The companion does not replace traditional forms of therapy but augments it and supports people in their daily lives,” said Panda founder Alon Lits.
Panda encrypts all backups and access to AI conversations is completely private, Lits said in emailed comments.
Tech experts like Steyn hope that robust regulation will eventually be able to “protect against unethical AI practices, strengthen data security, and keep healthcare standards consistent”.
From the United States to the EU, lawmakers are racing to regulate AI tools and pushing the industry to adopt a voluntary code of conduct while new laws are developed.
EMPATHY
Nonetheless, anonymity and a lack of perceived judgment are why people like 45-year-old Tim, a warehouse manager from Britain, turned to ChatGPT instead of a human therapist.
“I know it’s just a large language model and it doesn’t ‘know’ anything, but this actually makes it easier to talk about issues I don’t talk to anyone else about,” said Tim — not his real name — who turned to the bot to ward off his chronic loneliness.
Research shows that chatbots’ empathy can outweigh that of humans.
A 2023 study in the American JAMA internal medicine journal evaluated chatbot and physician answers to 195 randomly drawn patient questions from a social media forum.
They found that the bot’s answers were rated “significantly higher for both quality and empathy” compared to the physician’s.
Researchers deduced that “artificial intelligence assistants may be able to aid in drafting responses to patient questions”, not replace physicians altogether.`
But while bots may simulate empathy, this will never be the same as the human empathy people long for when they call a helpline, said former NEDA counsellor Doyle.
“We should be using technology to work alongside us humans, not replace us,” she said.
On April 26, The Lancet published a letter from two doctors at Taichung-based China Medical University Hospital (CMUH) warning that “Taiwan’s Health Care System is on the Brink of Collapse.” The authors said that “Years of policy inaction and mismanagement of resources have led to the National Health Insurance system operating under unsustainable conditions.” The pushback was immediate. Errors in the paper were quickly identified and publicized, to discredit the authors (the hospital apologized). CNA reported that CMUH said the letter described Taiwan in 2021 as having 62 nurses per 10,000 people, when the correct number was 78 nurses per 10,000
May 5 to May 11 What started out as friction between Taiwanese students at Taichung First High School and a Japanese head cook escalated dramatically over the first two weeks of May 1927. It began on April 30 when the cook’s wife knew that lotus starch used in that night’s dinner had rat feces in it, but failed to inform staff until the meal was already prepared. The students believed that her silence was intentional, and filed a complaint. The school’s Japanese administrators sided with the cook’s family, dismissing the students as troublemakers and clamping down on their freedoms — with
As Donald Trump’s executive order in March led to the shuttering of Voice of America (VOA) — the global broadcaster whose roots date back to the fight against Nazi propaganda — he quickly attracted support from figures not used to aligning themselves with any US administration. Trump had ordered the US Agency for Global Media, the federal agency that funds VOA and other groups promoting independent journalism overseas, to be “eliminated to the maximum extent consistent with applicable law.” The decision suddenly halted programming in 49 languages to more than 425 million people. In Moscow, Margarita Simonyan, the hardline editor-in-chief of the
Six weeks before I embarked on a research mission in Kyoto, I was sitting alone at a bar counter in Melbourne. Next to me, a woman was bragging loudly to a friend: She, too, was heading to Kyoto, I quickly discerned. Except her trip was in four months. And she’d just pulled an all-nighter booking restaurant reservations. As I snooped on the conversation, I broke out in a sweat, panicking because I’d yet to secure a single table. Then I remembered: Eating well in Japan is absolutely not something to lose sleep over. It’s true that the best-known institutions book up faster
RSS