config the vLLM engineArgs in config.pbtxt#63

Closed

activezhao wants to merge 17 commits into

triton-inference-server:mainfrom

activezhao:main

Commits on Oct 19, 2023

change the configuration of engineArgs in config.pbtxt
activezhao
committed

Commits on Oct 24, 2023

Hugging Face Transformer Deployment Tutorial (#49)
fpetrini15
authored

Commits on Oct 26, 2023

Updated version of vllm (#64)
oandreeva-nv
authored

Commits on Oct 27, 2023

Llama tutorial for TRTLLM (#62)
jbkyang-nvi
authored

Commits on Oct 31, 2023

Updated vllm tutorial to use vllm based container from NGC (#65)

oandreeva-nv
and
the-david-oy
authored

Commits on Nov 3, 2023

update path to tokenizer (#66)
jbkyang-nvi
authored

Commits on Nov 8, 2023

Commits on Nov 14, 2023

Add generate endpoint to Tutorial (#71)
fpetrini15
authored

Commits on Nov 22, 2023

change the configuration of engineArgs in config.pbtxt

activezhao
authored and
hanleyzhao
committed
change the configuration of engineArgs in config.pbtxt
activezhao
committed
Merge remote-tracking branch 'origin/main'
activezhao
committed
change the configuration of engineArgs in config.pbtxt
activezhao
committed
change the configuration of engineArgs in config.pbtxt

activezhao
authored and
activezhao
committed
change the configuration of engineArgs in config.pbtxt
activezhao
committed
change the configuration of engineArgs in config.pbtxt

activezhao
authored and
activezhao
committed
Merge remote-tracking branch 'origin/main'
activezhao
committed