Tag: Classification

All the articles with the tag "Classification".

• MOOSComp: Improving Lightweight Long-Context Compressor via Mitigating Over-Smoothing and Incorporating Outlier Scores

  Published: 4 May, 2025 |  at  04:29 PM

  

  77.68 🤔

  本文提出MOOSComp方法，通过在训练中添加inter-class cosine similarity loss缓解over-smoothing问题，并在压缩中整合outlier分数保留关键token，显著提升了任务无关的长上下文压缩性能和泛化能力。

• Rethinking Meta-Learning from a Learning Lens

  Published: 12 May, 2025 |  at  11:18 AM

  

  76.64 🤔

  This paper rethinks meta-learning from a 'learning' lens, proposing TRLearner, a plug-and-play method that leverages task relations to calibrate optimization, demonstrating significant performance improvements across regression, classification, drug activity, pose prediction, and OOD generalization tasks.

• Small or Large? Zero-Shot or Finetuned? Guiding Language Model Choice for Specialized Applications in Healthcare

  Published: 4 May, 2025 |  at  04:31 PM

  

  67.24 🤔

  本文通过实证实验指导在医疗专业应用中语言模型的选择，强调微调小语言模型和领域特定预训练的显著优势，使其在特定任务上超越零-shot 大语言模型。

• Compact Recurrent Transformer with Persistent Memory

  Published: 9 May, 2025 |  at  11:06 AM

  

  66.84 🤔

  This paper introduces the Compact Recurrent Transformer (CRT), which combines shallow Transformers with RNNs to efficiently process long sequences using a single persistent memory vector, achieving superior or comparable performance to full-length Transformers and Transformer-XL on language and video tasks with significantly reduced computational cost.

• How do Humans and Language Models Reason About Creativity? A Comparative Analysis

  Published: 10 May, 2025 |  at  10:59 AM

  

  60.58 🤔

  This paper conducts a comparative analysis of creativity evaluation in STEM, revealing that human experts and LLMs prioritize different facets of originality (cleverness vs. remoteness/uncommonness) and are differentially influenced by contextual examples, with LLMs showing higher predictive accuracy but poorer construct validity due to homogenized facet correlations.