dorsal/arxiv
View SchemaSearth Transformer: A Transformer Architecture Incorporating Earth's Geospheric Physical Priors for Global Mid-Range Weather Forecasting
| Authors | Tianye Li, Qi Liu, Hao Li, Lei Chen, Wencong Cheng, Fei Zheng, Xiangao Xia, Ya Wang, Gang Huang, Weiwei Wang, Xuan Tong, Ziqing Zu, Yi Fang, Shenming Fu, Jiang Jiang, Haochen Li, Mingxing Li, Jiangjiang Xia |
|---|---|
| Categories | |
| ArXiv ID | 2601.09467vv1 |
| URL | https://arxiv.org/abs/2601.09467 |
| License | http://arxiv.org/licenses/nonexclusive-distrib/1.0/ |
Abstract
Accurate global medium-range weather forecasting is fundamental to Earth system science. Most existing Transformer-based forecasting models adopt vision-centric architectures that neglect the Earth's spherical geometry and zonal periodicity. In addition, conventional autoregressive training is computationally expensive and limits forecast horizons due to error accumulation. To address these challenges, we propose the Shifted Earth Transformer (Searth Transformer), a physics-informed architecture that incorporates zonal periodicity and meridional boundaries into window-based self-attention for physically consistent global information exchange. We further introduce a Relay Autoregressive (RAR) fine-tuning strategy that enables learning long-range atmospheric evolution under constrained memory and computational budgets. Based on these methods, we develop YanTian, a global medium-range weather forecasting model. YanTian achieves higher accuracy than the high-resolution forecast of the European Centre for Medium-Range Weather Forecasts and performs competitively with state-of-the-art AI models at one-degree resolution, while requiring roughly 200 times lower computational cost than standard autoregressive fine-tuning. Furthermore, YanTian attains a longer skillful forecast lead time for Z500 (10.3 days) than HRES (9 days). Beyond weather forecasting, this work establishes a robust algorithmic foundation for predictive modeling of complex global-scale geophysical circulation systems, offering new pathways for Earth system science.
{
"annotation_id": "d8db66a9-13a6-45f3-8ea9-72ec966b10ec",
"date_created": "2026-02-17T05:53:20.295000Z",
"date_modified": "2026-02-17T05:53:20.295000Z",
"file_hash": "1a87dac2e851a7290437bf7765ec99934aa1f1de09c76065c45586153d8c848f",
"private": false,
"record": {
"abstract": "Accurate global medium-range weather forecasting is fundamental to Earth system science. Most existing Transformer-based forecasting models adopt vision-centric architectures that neglect the Earth\u0027s spherical geometry and zonal periodicity. In addition, conventional autoregressive training is computationally expensive and limits forecast horizons due to error accumulation. To address these challenges, we propose the Shifted Earth Transformer (Searth Transformer), a physics-informed architecture that incorporates zonal periodicity and meridional boundaries into window-based self-attention for physically consistent global information exchange. We further introduce a Relay Autoregressive (RAR) fine-tuning strategy that enables learning long-range atmospheric evolution under constrained memory and computational budgets. Based on these methods, we develop YanTian, a global medium-range weather forecasting model. YanTian achieves higher accuracy than the high-resolution forecast of the European Centre for Medium-Range Weather Forecasts and performs competitively with state-of-the-art AI models at one-degree resolution, while requiring roughly 200 times lower computational cost than standard autoregressive fine-tuning. Furthermore, YanTian attains a longer skillful forecast lead time for Z500 (10.3 days) than HRES (9 days). Beyond weather forecasting, this work establishes a robust algorithmic foundation for predictive modeling of complex global-scale geophysical circulation systems, offering new pathways for Earth system science.",
"arxiv_id": "2601.09467",
"authors": [
"Tianye Li",
"Qi Liu",
"Hao Li",
"Lei Chen",
"Wencong Cheng",
"Fei Zheng",
"Xiangao Xia",
"Ya Wang",
"Gang Huang",
"Weiwei Wang",
"Xuan Tong",
"Ziqing Zu",
"Yi Fang",
"Shenming Fu",
"Jiang Jiang",
"Haochen Li",
"Mingxing Li",
"Jiangjiang Xia"
],
"categories": [
"cs.LG",
"cs.AI",
"physics.ao-ph"
],
"license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
"title": "Searth Transformer: A Transformer Architecture Incorporating Earth\u0027s Geospheric Physical Priors for Global Mid-Range Weather Forecasting",
"url": "https://arxiv.org/abs/2601.09467",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "29c4ab71-5d43-43c8-96e7-bae6b65f710d",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}