Skip to content

DM-51627: Update mentions of cvmfs to almalinux-x86_64 instead of linux-x86_64 #723

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
airnandez merged 2 commits into from
Jul 1, 2025
Merged

DM-51627: Update mentions of cvmfs to almalinux-x86_64 instead of linux-x86_64 #723

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
1dc94f3
Update mentions of cvmfs to almalinux-x86_64 instead of linux-x86_64
airnandez Jun 30, 2025
66705e1
Further improvements to address reviewer's comments
airnandez Jul 1, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 7 additions & 2 deletions usdf/batch.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -312,7 +312,7 @@ to the desired ``site`` subsection. The ``monitorFilename`` field specifies the

.. note::

As of 2022-09-27, the ``parsl`` module and its dependencies are only available at S3DF via the CVMFS distributions of ``lsst_distrib`` for weekly ``w_2022_37`` and later. However, the modules needed for Parsl *monitoring* are not available in the CVMFS distributions. They can be installed in ``~/.local`` with the following commands::
The ``parsl`` module and its dependencies are available at S3DF via the CVMFS distributions of ``lsst_distrib`` for weekly ``w_2022_37`` and later. However, the modules needed for Parsl *monitoring* are not available in the CVMFS distributions. They can be installed in ``~/.local`` with the following commands::

$ source /cvmfs/sw.lsst.eu/linux-x86_64/lsst_distrib/w_2022_39/loadLSST-ext.bash
$ setup lsst_distrib
Expand All @@ -321,6 +321,11 @@ to the desired ``site`` subsection. The ``monitorFilename`` field specifies the

The ``pip uninstall sqlalchemy`` command is needed since the ``pip install 'parsl[monitoring]'`` command installs an earlier version of ``sqlalchemy`` that's incompatible with ``lsst_distrib``.


.. tip::

Weekly releases ``w_2025_11`` and later are exclusively built on AlmaLinux instead of CentOS 7. They can be found under ``/cvmfs/sw.lsst.eu/almalinux-x86_64/lsst_distrib/`` (note the ``almalinux-x86_64`` instead of ``linux-x86_64`` in the path).

Notes on each of the example configurations follow (Each class listed below lives in the ``lsst.ctrl.bps.parsl.sites`` namespace):

Local
Expand Down Expand Up @@ -363,7 +368,7 @@ In this class, a Parsl `LocalProvider <https://parsl.readthedocs.io/en/stable/st
#SBATCH --time=02:00:00

cd <working_dir>
source /cvmfs/sw.lsst.eu/linux-x86_64/lsst_distrib/w_2022_38/loadLSST-ext.bash
source /cvmfs/sw.lsst.eu/almalinux-x86_64/lsst_distrib/w_2025_26/loadLSST-ext.bash
setup lsst_distrib
<other setup commands>
bps submit <bps yaml file>
Expand Down
16 changes: 10 additions & 6 deletions usdf/stack.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,33 +8,37 @@ LSST Science Pipelines "stack" available at the USDF.
Release and Weekly
==================

Access to self-contained release and weekly versions is available via cvmfs (e.g. ``v24.0.0`` or ``w_2023_01``).
Access to self-contained release and weekly versions is available via cvmfs (e.g. ``v29.1.1`` or ``w_2025_26``).
Each version is available in three variants: a Conda environment with minimal dependencies for processing data, an extended Conda environment with packages appropriate for code developers, and an Apptainer container with the minimal environment.

Minimal processing Conda environment:

.. code-block:: bash

source /cvmfs/sw.lsst.eu/linux-x86_64/lsst_distrib/w_2023_01/loadLSST.bash
source /cvmfs/sw.lsst.eu/almalinux-x86_64/lsst_distrib/w_2025_26/loadLSST.bash

Developer-friendly Conda environment:

.. code-block:: bash

source /cvmfs/sw.lsst.eu/linux-x86_64/lsst_distrib/w_2023_01/loadLSST-ext.bash
source /cvmfs/sw.lsst.eu/almalinux-x86_64/lsst_distrib/w_2025_26/loadLSST-ext.bash

Minimal processing Apptainer:

.. code-block:: bash

apptainer run-help /cvmfs/sw.lsst.eu/containers/apptainer/lsst_distrib/w_2023_01.sif
apptainer run-help /cvmfs/sw.lsst.eu/containers/apptainer/x86_64/almalinux/lsst_distrib/w_2025_26

provides more information.

You can see which versions are available by:
``ls /cvmfs/sw.lsst.eu/linux-x86_64/lsst_distrib/``
``ls /cvmfs/sw.lsst.eu/almalinux-x86_64/lsst_distrib/``
and
``ls /cvmfs/sw.lsst.eu/containers/apptainer/lsst_distrib/``
``ls /cvmfs/sw.lsst.eu/containers/apptainer/x86_64/almalinux/lsst_distrib/``

.. note::

Stable and select weekly releases older than ``w_2025_11`` were built on the CentOS 7 Linux distribution (the previous reference platform). They are available under ``/cvmfs/sw.lsst.eu/linux-x86_64/lsst_distrib`` (note the ``linux-x86_64`` instead of ``almalinux-x86_64`` in the path).

Shared Stack
============
Expand Down