Tag: Large Language Model

All the articles with the tag "Large Language Model".

• SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wild

  Published: 8 May, 2025 |  at  06:17 PM

  

  86.55 🤔

  This paper investigates zero RL training on diverse open base models, achieving significant accuracy and response length improvements while identifying key factors like reward design and data difficulty that influence the emergence of reasoning behaviors.

• Exploring the Potential of Offline RL for Reasoning in LLMs: A Preliminary Study

  Published: 7 May, 2025 |  at  08:41 AM

  

  86.49 🤔

  本文通过探索离线强化学习方法（LD-DPO），在DeepDistill-32B模型上实现了平均3.3%的推理性能提升，尤其在Arena-Hard基准上提升10.1%，并强调了推理长度与语义丰富性平衡的重要性。

• Do We Truly Need So Many Samples? Multi-LLM Repeated Sampling Efficiently Scales Test-Time Compute

  Published: 10 May, 2025 |  at  10:59 AM

  

  86.42 🤔

  This paper introduces ModelSwitch, a multi-LLM repeated sampling strategy that leverages answer consistency to dynamically switch models, achieving superior performance and 34% sample efficiency over single-LLM self-consistency across diverse datasets.

• ZeroSearch: Incentivize the Search Capability of LLMs without Searching

  Published: 8 May, 2025 |  at  06:16 PM

  

  86.09 🤔

  ZEROSEARCH introduces a reinforcement learning framework that enhances LLMs' search capabilities by simulating search engines with fine-tuned LLMs, achieving performance comparable to or better than real search engines without API costs through a curriculum-based rollout strategy.

• Investigating Task Arithmetic for Zero-Shot Information Retrieval

  Published: 7 May, 2025 |  at  08:43 AM

  

  86.02 🤔

  本文提出任务算术方法，通过参数加减操作实现零样本信息检索的领域和语言适应，在科学、生物医学和多语言数据集上取得最高18%的NDCG@10提升，展现了轻量级模型适应的潜力。