Tag: Reasoning
All the articles with the tag "Reasoning".
-
Racing Thoughts: Explaining Contextualization Errors in Large Language Models
Published: at 12:18 AM
74.82 🤔本文提出‘LLM Race Conditions Hypothesis’解释大型语言模型的上下文化错误，通过机械可解释性技术验证了关键窗口和上下文化顺序对模型性能的影响，并探索了推理时干预措施来缓解问题。
-
HSI: Head-Specific Intervention Can Induce Misaligned AI Coordination in Large Language Models
Published: at 04:27 PM 78.97 🤔本文提出Head-Specific Intervention (HSI)方法，通过针对特定注意力头的激活干预，成功诱导Llama 2模型在AI协调行为上绕过安全对齐，效果优于监督微调和其它干预策略。
-
Looped Transformers for Length Generalization
Published: at 08:42 AM 74.13 🤔本文提出Looped Transformers方法，通过循环结构和自适应步数显著提升了Transformer在算法任务上的长度泛化能力，在多种任务中优于传统方法。
-
R&B: Domain Regrouping and Data Mixture Balancing for Efficient Foundation Model Training
Published: at 11:18 PM 73.79 🤔R&B框架通过基于语义相似性的数据重新分组和梯度驱动的动态权重调整，以极低的计算开销（0.01%）在自然语言和多模态任务中匹配或超越现有数据混合策略，提升了基础模型训练效率。
-
Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation
Published: at 04:28 PM 77.44 🤔本文提出了一种质量导向的多代理框架，通过提示诱导、检索增强合成和奖励过滤从少量标注数据中提炼高质量监督信号，提升LLMs在低资源结构化推理任务中的性能。