Tag: Bidirectional Attention
All the articles with the tag "Bidirectional Attention".
-
Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective
Published: at 11:23 AM
85.84 🤔本文提出基于扩散语言模型的文本嵌入方法DIFFEMBED，利用其双向注意力机制在长文档检索和推理密集型任务上显著优于自回归LLM嵌入模型，同时在传统嵌入任务上表现相当。