Tag: Heterogeneous Systems
All the articles with the tag "Heterogeneous Systems".
-
StreamRL: Scalable, Heterogeneous, and Elastic RL for LLMs with Disaggregated Stream Generation
Published: at 04:29 PM
79.93 🤔本文提出 StreamRL 框架，通过分离式流生成架构优化 RL 训练，解决了流水线和偏斜气泡问题，提高了 LLMs RL 训练的吞吐量和成本效率。