Nice tour through numerical weather prediction. But also: neural operators are to physics as attention is to language?

Most of AI is pointed at language. Anima Anandkumar points it at the physical world, weather, fusion, materials, the systems physics writes down as equations, and finds the usual playbook breaks. There isn't enough data, the resolution is brutal, and no transformer is big enough. Her way through is older than deep learning: build the structure of the world into the model. It already produces weather forecasts that rival the supercomputers on a single GPU.

🔬 Why Transformers Hit a Wall the Moment Physics Shows Up — Anima Anandkumar, Caltech - YouTube ↗