The Technology
Ongoing Story — 134 related articlesNew benchmark tests language models on real robot-arm tasks
Artificial Analysis launched a research-preview benchmark in which language models control a robot arm across eight tabletop tasks. It reports GPT-6 Astra scored 69 out of 100 and averaged about 30 minutes per task, compared with about 20 seconds for people. The small controlled test is not evidence of production-ready robotics; the results have not been independently replicated.
Read Full Story at Artificial Analysis