Structured output can create fake confidence
Constrained decoding seems like the greatest thing since sliced bread, but it often forces models to prioritize output conformance over output quality.
Visit Original Link →Structured output can create fake confidence
Link: https://boundaryml.com/blog/structured-outputs-create-false-confidence
Context
Spicy take and true! Somewhat true If your task is complex to get things out from image, or understand the context, it might hinder the quality. But if your task is to simply do something straightforward tool calls, structured output beats everything.
Source: techstructive-weekly-74