Elektrine lite

← Feed

@fd93@fosstodon.org

2026-05-06 23:09 UTC

@geolaw @Coho if AI researchers were sharing datasets then this would reduce the load on websites likewise if RAG for e.g. AI search results were optimized to use local caching rather than actually fetching the latest version of sites (it probably already does to a degree, but not sure how much...) note that both of these are easily achievable within an academic context, but not a free market one

Replies (1)

  • @glassresistor@sfba.social 2026-05-09 04:18

    @fd93@fosstodon.org @geolaw@aus.social @Coho@mountains.social yep when I was running sf.gov(ironically fired due to a peers ai psychosis and mgmt cowardice) about a 2/3 of our traffic spikes were LLM scanners and rather than allow list specific bots and rate limiting everything else that cant be blocked outright like normal product had a non infra team turn on the horrible "checking if you are human" tracking interstitial and disabled it for LLMs in short they made real peoples lifes more annoying to deal with bad traffic patterns we didnt have and setup a fast lane for our biggest ddosers

    Open ##2262940