Datasets & Models
LIBERO benchmark
One of the most-used simulation benchmarks for vision-language-action models. Its score curves look great, which is exactly why it is where the argument about 'what the score actually measures' concentrates: it is doing two jobs at once — measuring capability and being gamed.
Claim Check
Claim Check · B
How much of a LIBERO score measures the environment instead of the model
A benchmark is doing two jobs at once: measuring capability and being gamed. When randomisation is thin, the second on…
LIBERO benchmark · OpenVLA · 2026-09-28
Claim Check · B
'The simulation score is high, so it will work on hardware': where that breaks
Treat simulation as a filter, not a promise. A policy that scores well in sim is worth trying on hardware; do not copy…
MuJoCo · LIBERO benchmark · OpenVLA · 2026-09-28