2026-04-23 14:19 UTC
@perpetuum_mobile@mastodon.social
Since Gemma4 came out, I agree it's been the gold standard for performance vs compute. If SoC is the way forward for local compute (and I think its clear it is) the real jump happens when unified memory architectures can actually handle the token volume an agentic harness needs.
Progress on memory overhead for long-context agents, combined with advancements in unified pool architecture, make this a real possibility in the near future.
Replies (1)
-
@perpetuum_mobile@mastodon.social 2026-04-23 14:22
@mamba@mstdn.ca yes, DGX Spark is amazing little server that has 10 times the CPU compute than my homelab NUC and has the same form factor. Not to mention it almost (well, 25% is a big almost) matches 3090 in GPU compute. Amazing little piece of hardware