We audited LoCoMo: 6.4% of the answer key is wrong and the judge accepts up to 63% of intentionally wrong answers
Reddit r/LocalLLaMA / 2026/3/23
Reddit r/LocalLLaMA / 2026/3/23
Dev.to / 3/23/2026
Reddit r/LocalLLaMA / 3/23/2026
Dev.to / 3/23/2026
Dev.to / 3/23/2026
Dev.to / 3/23/2026

The Verge / 3/23/2026
The Register / 3/23/2026
Dev.to / 3/23/2026