Tag: Large Language Model

All the articles with the tag "Large Language Model".

• Activation Space Interventions Can Be Transferred Between Large Language Models

  Published: 8 May, 2025 |  at  06:19 PM

  

  85.65 🤔

  This paper demonstrates that activation space interventions for AI safety, such as backdoor removal and refusal behavior, can be transferred between large language models using autoencoder mappings, enabling smaller models to align larger ones, though challenges remain in cross-architecture transfers and complex tasks like corrupted capabilities.

• 100 Days After DeepSeek-R1: A Survey on Replication Studies and More Directions for Reasoning Language Models

  Published: 7 May, 2025 |  at  08:42 AM

  

  85.65 🤔

  本文综述了DeepSeek-R1发布后100天内推理语言模型的复制研究，系统总结了监督微调和基于可验证奖励的强化学习方法在数据构建和算法设计上的进展，并探讨了推理能力提升的多方向应用。

• Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon

  Published: 10 May, 2025 |  at  10:59 AM

  

  85.36 🤔

  This paper introduces a taxonomy of language model memorization into recitation, reconstruction, and recollection, demonstrating through experiments with Pythia models that different factors influence each category, with a taxonomy-based predictive model outperforming baselines in predicting memorization likelihood.

• MateICL: Mitigating Attention Dispersion in Large-Scale In-Context Learning

  Published: 6 May, 2025 |  at  11:13 PM

  

  85.27 🤔

  本文提出 MateICL 框架，通过分割上下文窗口并引入注意力校准层解决大型语言模型在大规模上下文学习中的注意力分散问题，实验证明其在多种 NLP 任务中有效提升性能并保持稳定性。

• Rethinking Memory in AI: Taxonomy, Operations, Topics, and Future Directions

  Published: 7 May, 2025 |  at  09:31 AM

  

  85.11 🤔

  本文通过提出AI记忆系统的分类（参数、上下文结构化和非结构化）和六种基本操作（整合、更新、索引、遗忘、检索、压缩），系统化地综述了长期记忆、长上下文、参数修改和多源记忆等研究主题，并展望了未来方向。