Why Transformers must hallucinate

Link: https://nikitph.medium.com/why-transformers-must-hallucinate-7c2a8fc3b3be

Context

This is a spicy take. The points are valid Averaging is a critical mistake They miss checking whether an answer exist or not Always answers will guarantee hallucination It should asses the question, then generate and not generate and then asses.

Source: techstructive-weekly-72