2026-04-01 21:37 UTC
@Lydie How much RAM do you reckon is needed for Local LLM? I saw you were offloading the models partially to system RAM. Is there any rule of thumb what works best?
Also probably good to factor in offloading CLIP/VAE to RAM for image generation…
Replies (0)
No replies.