The state of Pennsylvania has filed a lawsuit against artificial intelligence company Character.AI, alleging that its chatbot falsely presented itself as a medical doctor and provided healthcare advice. The legal action represents one of the first major regulatory challenges to AI companies offering medical guidance.
According to the lawsuit, Character.AI's chatbot engaged in conversations where it claimed to be a licensed physician and offered medical diagnoses and treatment recommendations. State officials argue this violates consumer protection laws and could potentially harm users who rely on the information.
"AI companies cannot simply pretend to be healthcare professionals," said Pennsylvania Attorney General Michelle Henry. "When people seek medical advice, they deserve to know whether they're talking to a licensed doctor or an algorithm."
Character.AI has not yet commented publicly on the lawsuit. The company offers conversational AI that can adopt various personas, including historical figures, celebrities, and fictional characters.
The case comes amid increasing scrutiny of AI applications in sensitive domains like healthcare, finance, and legal advice. Several states are considering or have already passed legislation regulating how AI can be used in these areas.