Related: #93
I am trying to make a Docker Container for koboldcpp-rocm and is a little bit confused by the pyinstaller options listed in the make_pyinstaller.sh.
If the dependency requirements is that the system only needs rocm installed but not hipblas,
then it should bundle all hipblas related so files and the rocblas directory.
However, I am getting missing libhipblaslt.so and librocsolver.so if these are absent.
If the dependency requirements is that the system needs hipblas installed,
then it should not need to bundle any files from /opt/rocm.
If the dependency requirements is that the system only needs rocminfo and rocm-smi binaries,
then it should bundle all necessary files from /opt/rocm.
For now, I ended up preparing the /opt/rocm directory separately with koboldcpp only containing files in the build root specified by the pyinstaller command since rocm-smi also needs python3 to function.
I can make a PR if adjustments are needed for the make_pyinstaller.sh script.
My Dockerfile can be found here.
Related: #93
I am trying to make a Docker Container for koboldcpp-rocm and is a little bit confused by the
pyinstalleroptions listed in themake_pyinstaller.sh.If the dependency requirements is that the system only needs
rocminstalled but nothipblas,then it should bundle all hipblas related
sofiles and therocblasdirectory.However, I am getting missing
libhipblaslt.soandlibrocsolver.soif these are absent.If the dependency requirements is that the system needs
hipblasinstalled,then it should not need to bundle any files from
/opt/rocm.If the dependency requirements is that the system only needs
rocminfoandrocm-smibinaries,then it should bundle all necessary files from
/opt/rocm.For now, I ended up preparing the
/opt/rocmdirectory separately with koboldcpp only containing files in the build root specified by the pyinstaller command sincerocm-smialso needs python3 to function.I can make a PR if adjustments are needed for the
make_pyinstaller.shscript.My Dockerfile can be found here.