Not student-ready
The sentence models found language signal—and lost the academic task.
Across public ASL sentence diagnostics, the useful result was not a translator. It was reproducible proof that critical meaning can disappear behind fluent-looking text.26.09%best literal critical-token recall on the first locked Uni-Sign diagnostic
147.71%mean word error on that six-clip diagnostic
0%critical-token recall from the earlier Qwen research bridge
- What entered the product
- The candidate must remain visibly provisional. Repair cannot be a hidden cleanup step after the model has already decided what the signer meant.
- Next evidence gate
- A future recognizer must pass signer-independent, academically critical, Deaf-adjudicated evidence before confirmation can become selective.
- Source program
- Uni-Sign and Qwen locked public-ASL diagnostics
