Integrate DeepSpeed #22
Description
Integrate Microsoft's deepspeed into the template https://www.deepspeed.ai/
This will allow for the usage of arbitrarily bigger models which don't have to fit in VRAM.
{{ message }}
Integrate Microsoft's deepspeed into the template https://www.deepspeed.ai/
This will allow for the usage of arbitrarily bigger models which don't have to fit in VRAM.