When Models Manipulate Manifolds: The Geometry of a Counting Task
This paper investigates how Claude 3.5 Haiku performs linebreaking in fixed-width text by representing character counts on curved manifolds and using attention heads to geometrically transform these representations for …
AI · Architecture