Hmmm.

But this phenomenon is not limited to weekdays. In the full paper, we find analogous structure in language models across more complex settings, including months, letters, ages, and a synthetic in-context learning task with predefined geometries. We also extend our results across modalities with an image-action model predicting the position of a car rolling up and down a hill (see the demo in our previous post). Across these tasks, manifold geometry provides a practical blueprint for steering model behavior.

Steering Along Manifolds to Control Neural Networks - Goodfire ↗