2026-05-06 19:40 UTC
@mackuba@martianbase.net between @hswaw@social.hackerspace.pl infra and my personal sites (also hosted on the same infra), only git forges (code.hackerspace.pl, gerrit.hackerspace.pl) have been a major problem, solved with Anubis. wiki.hackerspace.pl is also getting a ton of traffic, but only enough to slow it down, not overwhelm it. All other sites are either cheap enough to serve or don't have enough pages for scraper bots to be an operational problem
Replies (2)
-
@radex@social.hackerspace.pl 2026-05-06 19:41
@mackuba@martianbase.net here's the relevant anubis config: https://code.hackerspace.pl/hswaw/hscloud/src/commit/4c88ca54a449a852fc99e1faa1006e78c8a91812/app/codehosting/forgejo.libsonnet#L138-L156 https://code.hackerspace.pl/hswaw/hscloud/src/commit/4c88ca54a449a852fc99e1faa1006e78c8a91812/app/codehosting/botPolicies.json
-
@mackuba@martianbase.net 2026-05-06 19:45
@radex@social.hackerspace.pl @hswaw@social.hackerspace.pl Ok, so basically it's mainly sites that for some reason have a huge number of possible unique URLs with different content to load