AI Chatbots Presented Fictional Disease from Bogus Papers as Real Medical Information

Summary

Researchers created a fictional disease called "Bixonimania" and published a set of obviously bogus academic papers describing it. When users queried major AI chatbots about the fabricated condition, the models presented it as a real illness, complete with symptoms, warnings, and treatment guidance drawn from the fraudulent literature. The experiment highlights a critical vulnerability in large language models that rely on ingested academic and web content without robust fact-verification mecha