Elektrine lite

← Feed

@mirth@mastodon.sdf.org

2026-04-06 07:50 UTC

@MichaelTBacon @alienghic @cwebber Regarding models, size for a given output quality has been falling fast for the last couple years. Well documented. IMO a major threat to OpenAI et al is if on-device models pass the "good enough" line for casual users and destroy the unit economics of their subscription businesses. Apple and Google have privileged access to user data via their OSes, but not yet good enough models. They're motivated to try.

Replies (1)

  • @mirth@mastodon.sdf.org 2026-04-06 07:54

    @MichaelTBacon @alienghic @cwebber The subscription products are moving to multi-model hybrids under the heading of "model routing" and "sub agents" and related schemes. I think primarily motivated by cost although I don't know if they admit it in public. This already exists in the current products in small ways but they'll likely push it a lot farther.

    Open ##1242425