8000 vllm/docs/training/trl.md at main · tongyx361/vllm · GitHub
[go: up one dir, main page]

Skip to content

Latest commit

 

History

History
12 lines (8 loc) · 1.06 KB

trl.md

File metadata and controls

12 lines (8 loc) · 1.06 KB

Transformers Reinforcement Learning

Transformers Reinforcement Learning (TRL) is a full stack library that provides a set of tools to train transformer language models with methods like Supervised Fine-Tuning (SFT), Group Relative Policy Optimization (GRPO), Direct Preference Optimization (DPO), Reward Modeling, and more. The library is integrated with 🤗 transformers.

Online methods such as GRPO or Online DPO require the model to generate completions. vLLM can be used to generate these completions!

See the guide vLLM for fast generation in online methods in the TRL documentation for more information.

!!! info For more information on the use_vllm flag you can provide to the configs of these online methods, see: - trl.GRPOConfig.use_vllm - trl.OnlineDPOConfig.use_vllm

0