AI Hallucinations Worsen Customer Demands
Artificial intelligence generates inaccurate information on food allergies, leading to dangerous situations in restaurants where customers trust AI more than staff.
Inaccurate responses from generative artificial intelligence, such as ChatGPT, concerning food allergies are creating challenges within the restaurant industry. Madison, a server in New York City, reports that customers have begun questioning information about food ingredients, citing AI-generated data.
This phenomenon leads to dangerous situations where allergens harmful to customers' health may end up in their meals. According to Madison, customers who claim to be allergic to shellfish, for example, still order dishes prepared with shellfish, justifying their choices with AI's claims.
"They just want to talk to ChatGPT," Madison describes the situation where customers place more trust in incorrect AI-provided information than a warning from the server. This has resulted in customers no longer asking follow-up questions about food when informed of potential allergens.
The reporting on this issue highlights the need for information verification and critical thinking regarding AI-generated content, especially when it pertains to health and safety.