VLM-RM: Specifying Rewards with Natural Language | FAR AI
We show how to use Vision-Language Models (VLM), and specifically CLIP models, as reward models (RM) for RL agents. Instead of manually specifying a reward function, we only need to provide text...