Skip to content

Update train-cloud-microphysics demo app for merged ICAR files#287

Merged
rouson merged 18 commits intomainfrom
train-on-new-file-format
Feb 3, 2026
Merged

Update train-cloud-microphysics demo app for merged ICAR files#287
rouson merged 18 commits intomainfrom
train-on-new-file-format

Conversation

@rouson
Copy link
Contributor

@rouson rouson commented Feb 3, 2026

With this PR, putting the latest ICAR NetCDF training data files in a subdirectory demo/fiats-training-data and running something like

cd demo
./setup.sh
ln -s `find build -name train-cloud-microphysics`
./train.sh

should launch a run that does successively refined training of a cloud microphysics model by conditionally sampling the training data to flatten the output-tensor histograms.

This PR

  1. Adjusts the demonstration application in demo/app/traini-cloud-microphysics.F90 and related files to process the ICAR training-data files that resulted from merging image-specific files into one regional file per 50 time steps;
  2. Updates demo/train.sh to improve robustness by
    • Adding a check for the executable file and exiting if it's not found,
    • Adding default values for command-line arguments,
    • Removing unused command-line arguments, and
    • Updating to Julienne 3.6.1 to fix a crash that occurs when the network file already exists;
  3. Adds file types to .gitignore;
  4. Renames an example's supporting module to leverage default preprocessing;
  5. Makes training output more verbose, including
    • more descriptions of intermediate steps and
    • printing epoch and cost function values.
  6. Aggregates tensors across files for training.

rouson added 18 commits February 2, 2026 17:51
This commit adds several file types to ignore:
* archives & compressed files: *.gz, *.tar, etc.
* gnuplot & graphics: *.plt, *.png
* macos: .DS_Store
Remove variables that are no longer used.
With this commit, the demo/train.sh training script
1. Exits if any simple command returns a non-zero exit code,
2. Uses default values for the starting and ending number of bins,
3. Makes the executable path/name a variable with a default, and
4. Removes unused arguments form the training proggram launch line.
This update fixes an issue with demo/app/train-cloud-microphysics
that occured when an attempt is made to open an already open file.
@rouson rouson merged commit c25a52b into main Feb 3, 2026
4 checks passed
@rouson rouson deleted the train-on-new-file-format branch February 3, 2026 05:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant