Babble

Standalone LLM crawler tarpit binary. Generates an endless stream of deterministic bollocks to be ingested by bots, with plenty of links.

Why?

• Divert and slow down LLM crawler traffic, protecting your main site
• Potentially poison LLM training data (likely not very effective)
• Collective defence; the more time a scraper spends swallowing babble, the less time it'll spend bulling someone else's site
• Do your bit to protect the public commons from those who would readily see it destroyed for the sake of an investment round

Usage

--cert <path> | Path of `cert.pem` (for TLS)
--key <path> | Path of `key.pem` (for TLS)
--sock <address> | Bind to the given socket. Defaults to 0.0.0.0:3000.

Babble will search for a robots.txt file in the working directory to use. If it does not find one, it will use a default one that denies everything.

Babble will periodically emit statistics into stats.txt, showing information about the worst-offending requesting IPs.

Warning

Deploy it in a docker environment. It's probably safe, but no reason to take chances.

Usage terms

There are none, other than those implied by dependencies. Use it whenever and wherever you want, and in any way.

Attribution

Fuck you, Sam Altman.