detect resource constraints to set default parameters#4108

dtrawins merged 28 commits into

mainopenvinotoolkit/model_server:mainfrom

limit-workersopenvinotoolkit/model_server:limit-workersCopy head branch name to clipboard