Posts
All the articles I've posted.
-
Language Models are Universal Embedders
Published: at 11:41 AM
85.00 🤔本文基于多语言解码器模型（如BLOOM）提出通用嵌入器构建方法，通过对比学习和参数高效微调实现跨语言、跨任务的高质量嵌入，实验表明其在多语言和多任务场景中具有显著潜力和泛化能力。
-
ExpertSteer: Intervening in LLMs through Expert Knowledge
Published: at 11:10 AM 85.00 🤔EXPERTSTEER提出了一种创新的激活转向方法，通过自编码器、互信息分析和递归特征机从外部专家模型生成转向向量，干预任意目标大型语言模型的行为，在多个领域和模型上显著提升性能。
-
ICLR: In-Context Learning of Representations
Published: at 08:41 AM 84.18 🤔本文通过上下文图追踪任务揭示了大型语言模型能随上下文规模增加而突现地重组概念表示以适应新语义，并提出能量最小化假设解释这一过程。
-
Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models
Published: at 06:19 PM 83.98 🤔This paper introduces a recursive summarization method to enhance long-term dialogue memory in LLMs, achieving marginal quantitative improvements and notable qualitative gains in consistency and coherence across multiple models and datasets.
-
What do Language Model Probabilities Represent? From Distribution Estimation to Response Prediction
Published: at 08:42 AM 83.92 🤔本文通过理论分析区分了语言模型输出概率的三种解释（完成分布、响应分布、事件分布），揭示了现有研究中对这些分布的混淆和误解，并呼吁谨慎解释模型概率以指导LLM的开发和应用。