What inference speeds do you guys get?

[kalebbroo]

I have recently been testing this and I cant seem to get speeds comparable to Comfy. I was just wondering if that was expected or if I was missing something. I created an image in Comfy and then SDcpp and it seems to be 1.5x-2x slower on SDcpp.

Is this normal? I have tried playing with all the cache and perf args but nothing really helps.

[stduhpf]

It depends on the backend you're using I guess. On my end, comparing ROCm backend to ComfyUI-Zluda, sd.cpp is about 2x faster.

[kalebbroo]

https://github.com/HartsyAI/SwarmUI-SD.cpp-Backend

I have been using CUDA. I assumed that would be the fastest. I made an extension to SwarmUI to use SDcpp and its working great. I just need to figure out that speed issue im having and I think I can start showing people how perfect this is to swap out in Swarm.