Tag: Data Diversity

All the articles with the tag "Data Diversity".

• Competition Dynamics Shape Algorithmic Phases of In-Context Learning

  Published: 9 May, 2025 |  at  11:08 AM

  

  85.25 🤔

  This paper introduces a synthetic sequence modeling task using finite Markov mixtures to unify the study of in-context learning (ICL), identifying four competing algorithms that explain model behavior and phase transitions, thus offering insights into ICL's transient nature and phenomenology.