@Spite_By_Design_LLC@lemmy.dbzer0.com
2026-11-02 05:32 UTC
That should be well within reach of something like Ornith running on Polystrata
huggingface.co/bartowski/Ornith-1.5-35B-A3B-GGUF
github.com/VecSzn/PolyStrata
Try a Q4 size
Hell, Tiny Ling 3 might be able to do it
huggingface.co/bartowski/Ling-3.0-tiny-GGUF
Try a Q6
Replies (0)
No replies.