@stekopf@mstdn.social in the meantime, I’m pretty happy with llama-server coming with llama-cpp