Study shows AI chatbots can blindly repeat incorrect medical details
Amid increasing presence of Artificial Intelligence tools in healthcare, a new study warned that AI chatbots are highly vulnerable to repeating and elaborating on false medical information.
Researchers at the Icahn School of Medicine at Mount Sinai, US, revealed a critical need for stronger safeguards before such tools can be trusted in health care.
The team also demonstrated that a simple built-in warning prompt can meaningfully reduce that risk, offering a practical path forward as the technology rapidly evolves.
"What we saw across the board is that AI chatbots can be easily misled by false medical details, whether those errors are intentional or accidental," said lead author Mahmud Omar, from the varsity.
"They not only repeated the misinformation but often expanded on it, offerin...










