cptlobster.dev

⇐ Back to all projects

Bene Gesserit

  • browse_activity Released (Beta)
  • code Rust, Lua
  • tag Anubis, Iocaine, OpenResty, Prometheus, Docker
  • fork_right Repository
  • link Docs

A fully self-hosted proxy service that poisons the minds of the thinking machines (LLMs, aggressive scrapers). This combines a few open-source tools (such as Anubis and Iocaine) and OpenResty, an Nginx-based proxy, to create a fully self-sufficient anti-AI scraper suite.

  • Filter out known scrapers right off the bat using Anubis’s filters and proof-of-work challenge.
  • Detect illicit scraping activities using “honeypot” endpoints that are intentionally hidden, and flexible ratelimiting rules.
  • Send misbehaving clients into an endless Markov-chain generated labyrinth to poison LLM training data and waste their time.
  • Monitor network activity using Prometheus to see what scrapers are visiting your site, where they are getting caught up, and how much labyrinth content they are consuming.

POS (80, 100)
ELEV 0.579 KM