Tag: Generalization

All the articles with the tag "Generalization".

• On the generalization of language models from in-context learning and finetuning: a controlled study

  Published: 4 May, 2025 |  at  04:33 PM

  

  82.00 🤔

  本文通过控制实验比较了语言模型在上下文学习和微调下的泛化能力，发现上下文学习更灵活，并提出通过数据增强方法显著改善微调的泛化性能。

• Rethinking Meta-Learning from a Learning Lens

  Published: 12 May, 2025 |  at  11:18 AM

  

  76.64 🤔

  This paper rethinks meta-learning from a 'learning' lens, proposing TRLearner, a plug-and-play method that leverages task relations to calibrate optimization, demonstrating significant performance improvements across regression, classification, drug activity, pose prediction, and OOD generalization tasks.

• Rethinking Invariance in In-context Learning

  Published: 12 May, 2025 |  at  11:15 AM

  

  71.91 🤔

  This paper introduces Invariant In-Context Learning (InvICL), a novel ICL method that achieves permutation invariance, information non-leakage, and context interdependence using leave-one-out encoding and parallel implementation, outperforming both invariant and non-invariant baselines in generalization and performance across synthetic and real-world tasks.