[REQUEST] Run more than 100 samples through the pipeline

[kenanoestreich]

Type of Request

• Functionality
• UX/UI
• Documentation
• Quality of Life
• Other

Is your feature request related to a problem? How pervasive is the problem? Please describe.
Running more than 100 samples breaks the pipeline. I don't know if this is purely a RAM issue or not.

Describe the solution you'd like
It would be nice if it could either 1) work for more scans if possible or 2) check if there is enough RAM and do not go ahead with the process if it won't have enough memory.

Describe alternatives you've considered
N/A

[tparkerd]

@kenanoestreich Do you have any log files for one attempting to run more than 100 samples at once? I believe the number of CPUs used caps out at around 8, so no more than 8 samples is likely being processed at once. Is it crashing at a specific step?