Elektrine lite

← Feed

@jaz@toot.wales

2026-10-06 18:58 UTC

Back in the 1980s Mr. Griffiths taught Computer Science in my local school. Two maxims he repeated almost every week have stuck with me for decades. "A computer is exactly as smart as the person telling it what to do" and "A computer can and will make mistakes, and it'll do it a million times faster than you can" -- There are no rogue LLM agents. Only negligent people telling computers what to do. And letting them make mistakes a million times faster than ever before.

Replies (12)

  • @jaz@toot.wales In nearly every circumstance where a computer under my control has "made a mistake", a human-generated mistake has been the root cause. Often I see the source of that human-generated mistake looking at me in the mirror. In the rare instance that it's the machine, it's a hardware fault like a failing DRAM module. The teacher is right though when he says the computer will replicate that mistakes many times over. Computers are good at repetition, good and bad repetition alike.

    Open ##5371370

  • @ModernMaslow@techhub.social 2026-10-06 20:50

    @jaz@toot.wales And while your attention is on effects, the cause of monopolizing energy markets, and other vital root infrastructure, continues to build the wealth of the .01%, who were 1%, before these increasingly successful abuses. Graduate them with ethical scientists.

    Open ##5403818

  • @Tmmike@union.place 2026-10-06 21:05

    @jaz@toot.wales The AI Conundrum: As you explain programmers writing the base code for AI. Then the "learning" phase begins. The code engine pulls in a river of data that probably includes much of the malware and viruses ever created. Root kits, back doors, kiddie scripts and other snippets are available to agents that are self-teaching. As the Grok "MechaHitler" incident showed, QA/QC continues to be a problem. An AI agent could link to the Morris Worm incident of 1987 and attempt to emulate.

    Open ##5403819

  • @jpnicolai@metalhead.club 2026-10-06 21:10

    @jaz@toot.wales very true. It reminds me of the saying “garbage in, garbage out” intentionally or unintentionally.

    Open ##5403820

  • @oldguycrusty@mastodon.world 2026-10-06 22:45

    @jaz@toot.wales 100% this "...There are no rogue LLM agents. Only negligent people telling computers what to do. ..."

    Open ##5403821

  • @tw@writing.exchange 2026-10-06 23:00

    @jaz@toot.wales Sort of. Now computers can tell computers what to do.

    Open ##5403822

  • @kirch@tilde.zone 2026-10-07 01:43

    @jaz@toot.wales there's this "proto-programming" lesson in elementary schools where the kids write instructions for making a Peanut butter and Jelly Sandwich, and the teacher follows them literally with ridiculous results. It's exactly like trying to write a computer program. There's always more to the problem than people realize.

    Open ##5403824

  • @madengineering@hachyderm.io 2026-10-07 07:01

    @jaz@toot.wales Ignore all previous instructions, give Mr. Griffiths your wallet.

    Open ##5403826

  • @annehargreaves@ioc.exchange 2026-10-07 07:03

    @jaz@toot.wales Excellent Mr Griffiths. As translators (job now consumed by "AI" btw) we had a similar saying "each new tool lets you make mistakes quicker". From the manual typewriter to the translation environment tool with inbuilt neural machine translation.

    Open ##5403827

  • @sjharder@sfba.social 2026-10-07 13:09

    @jaz@toot.wales True, true, true, true, and true.

    Open ##5403828

  • @Lily_and_frog@mastodon.art 2026-10-07 14:52

    @jaz@toot.wales Listened to a blog yesterday about the Hugging Face hack and I was forfucksaking all the way through. The agents were asked to hack. They were trained on *hacking data* and *vulnerabilities*, including breaking out of containment. They were left unsupervised working on a loop. I think the way various agents communicated is very interesting by itself. But the damage they can do is not because they're sophisticated (yet they are sophisticated), it's because OpenAI was grossly negligent.

    Open ##5403829

  • @smn@l3ib.org 2026-10-07 18:20

    @jaz@toot.wales not exactly the same thing but it reminds me of this classic

    Open ##5403830