2026-02-21 18:51 UTC
@emilymbender@dair-community.social It's so incredibly sad we have found a method to turn any snippet of text into some numbers that somehow encode the meaning behind it, and yet the most popular usecase is just guessing what the next word is
Replies (2)
-
@dalias@hachyderm.io 2026-02-21 21:42
@me@mastodon.seahousen.eu @emilymbender@dair-community.social They don't encode the meaning. They encode the correlation to the *form* (NOT meaning) of elements of a corpus of past written text.
-
@cholling@bytes.programming.dev 2026-02-23 10:16
@me@mastodon.seahousen.eu @emilymbender@dair-community.social If it makes you feel better, no, we haven't figured out how to turn words into numbers that "somehow encode the meaning behind it". There are no meanings in text, only more words. Without a ton of background information LLMs do not possess, words are nothing but arbitrary symbols. Things like word2vec only tell us what other words a given word tends to hang out next to.