[Feature] Flux model and 4GB VRAM

[biocrypt]

Feature Summary

Tutorial howto run Flux model with 4GB VRAM

Detailed Description

Please provide tutorial how to run the Flux model with 4 GB VRAM. I tried models with lower precision without success.

Alternatives you considered

No response

Additional context

No response

[GreenShadows]

Try Flux.2 Klein 4B Q4 + flash attention.
Perhaps, Vae offload to CPU.