Research
7d agoQwen3.8 Struggles With Word-Based Addition
A test of Qwen3.8-27B reveals significant failures when computing sums and returning answers in words. The experiment, replicated from a GPT-4o study, shows that reasoning capabilities do not fully solve basic arithmetic errors in natural language.
The Signal
This highlights a persistent gap between logical processing and linguistic output for mid-sized local models.