DeepMind's RT-2 lets robots follow natural-language instructions
By encoding robot actions as text tokens, DeepMind's model reused web-scale vision-language pretraining and roughly doubled its predecessor's success rate on situations absent from its robot-specific training data.
Models & capabilities