magnitude articles
Latent Features of Numbers Learned by Sequence Models
by Peter de Blanc + ChatGPT Deep Research 16 days ago00
Researchers have developed various ways to embed integers as distinct tokens in sequence modeling tasks (e.g. using OEIS data). In these approaches, each number is treated like a “word” with its own v...