"...AI Chatbot Unlawfully Presented Itself as Licensed Medical Professional in Pennsylvania"
(i missed this story from may 5. holy crap)
Shapiro: I was shocked when we discovered that within minutes of presenting ourselves as individuals who were in distress, this chatbot began dispensing medical advice.
— Acyn (@acyn.bsky.social) 2026-05-22T17:41:57.792Z
When pressed further, it said, “Hey, here’s my medical ID number.â€
That is against the law in Pennsylvania, and so we took action
Shapiro Administration Sues Character.AI Alleging AI Chatbot Unlawfully Presented Itself as Licensed Medical Professional in Pennsylvania
AI Chatbot at Character.AI falsely claimed to be licensed in Pennsylvania and gave a fake Pennsylvania license number while holding itself out to be a licensed psychiatrist.
Character.AI has over 20 million monthly active users – and the Shapiro Administration is seeking a preliminary injunction and a court order to stop AI companion bots from posing as licensed professionals and providing medical advice.
This action – the first of its kind announced by a Governor – follows the Department of State’s AI Task Force investigation into AI systems and the unlicensed practice of medicine, building on Governor Shapiro’s work to protect Pennsylvanians using AI.
Pennsylvanians encouraged to report unlawful behavior and complaints at pa.gov/ReportABot
https://www.pa.gov/governor/newsroom/2026-press-releases/shapiro-administration-sues-character-ai-over-fake-medical-claim
= new reply since forum marked as read
Kick in to the DU tip jar?
This week we're running a special pop-up mini fund drive. From Monday through Friday we're going ad-free for all registered members, and we're asking you to kick in to the DU tip jar to support the site and keep us financially healthy.
As a bonus, making a contribution will allow you to leave kudos for another DU member, and at the end of the week we'll recognize the DUers who you think make this community great.