LUCIE model integration tracker #211
Description
LUCIE is a climate model developed by Haiwen Guan, Troy Arcomano, Ashesh Chattopadhyay and Romit Maulik (2024). See their preprint at https://doi.org/10.48550/arXiv.2405.16297 and the archive of their training data, code and results here https://doi.org/10.5281/zenodo.15164648.
The code in PyEarthTools was based on their code repository at https://github.com/ISCLPennState/LUCIE, which is made available under the MIT license (see the PyEarthTools NOTICE file for full information on this point)
LUCIE is a model which of interest to climate researchers due to its long-term stability for rollouts for many decades. This model is licensed in a compatible fashion, so we are able to provide a bundled, customised version of LUCIE which can be used within the PyEarthTools framework, integrated with its data pipelines and configurable to work flexibly.
We have only just begun the process of this integration, and so for now the model does not make extensive use of the PyEarthTools classes. This is expected to change fairly quickly, and as this happens, this notebook will be updated. However, in the interests of providing the bundled version to the community as soon as possible for those already seeking to work with the model, we present it in a "work in progress" fashion.
The intention is to:
- [done] Supply the source code to train and run the model in PyEarthTools
- [done] Validate that the model can train without obvious code-level errors
- Validate inference and reproduce the training results to ensure the trained model is valid
- Support library updates and other changes
- Support multiple ML backends beyond CUDA
- Support connection to multiple data sources through PET data accessors
- Move the normalisation into a PET pipeline so it can be easily modified and experimented with
- Add API docs once the code has been refactored
If you would like to know more, or get involved with this work, please let us know on the issue tracker