Tag: Supervised Learning

All the articles with the tag "Supervised Learning".

• Long-Short Chain-of-Thought Mixture Supervised Fine-Tuning Eliciting Efficient Reasoning in Large Language Models

  Published: 8 May, 2025 |  at  06:12 PM

  

  91.54 🤔

  This paper introduces Long-Short Chain-of-Thought Mixture Supervised Fine-Tuning (LS-Mixture SFT), which combines long and short CoT datasets to fine-tune non-reasoning LLMs, achieving a 2.3% average accuracy improvement and 47.61% response length reduction on reasoning benchmarks.

• Always Skip Attention

  Published: 8 May, 2025 |  at  11:06 AM

  

  89.20 🤔

  This paper theoretically demonstrates the ill-conditioning of Self-Attention Blocks in Vision Transformers without skip connections, highlights their role as regularizers, and proposes Token Graying (SVD and DCT) to improve input token conditioning, achieving modest performance gains in supervised and self-supervised tasks.

• Nonparametric learning of covariate-based Markov jump processes using RKHS techniques

  Published: 8 May, 2025 |  at  12:18 AM

  

  88.71 🤔

  本文提出了一种基于再生核希尔伯特空间（RKHS）的非参数化方法，通过频率学和贝叶斯框架建模连续时间马尔可夫链（CTMC）中协变量驱动的非线性转移率，显著提升了个体化状态转移预测的准确性。

• Sparse-Group Boosting with Balanced Selection Frequencies: A Simulation-Based Approach and R Implementation

  Published: 8 May, 2025 |  at  10:25 AM

  

  87.75 🤔

  This paper introduces sparse-group boosting and a simulation-based group balancing algorithm within the 'sgboost' R package to mitigate variable selection bias in high-dimensional grouped data, demonstrating improved fairness and interpretability through simulations and ecological data analysis.

• Think2SQL: Reinforce LLM Reasoning Capabilities for Text2SQL

  Published: 6 May, 2025 |  at  11:18 PM

  

  87.33 🤔

  本文通过结合监督微调（SFT）、强化学习（RL）及细粒度奖励函数（如QATCH），显著提升了小型LLM在Text2SQL任务中的推理能力和性能，Think2SQL-7B模型在BIRD数据集上超越了400B+参数模型。