Update techniques/nepenthes/technical_nepenthes.md
This commit is contained in:
parent
c299b69414
commit
e0f0719c88
|
|
@ -1,4 +1,4 @@
|
||||||
# Nepenthes — Infinite Tarpit for Content Protection
|
# Nepenthes - Infinite Tarpit for Content Protection
|
||||||
|
|
||||||
**Nepenthes** is a lightweight, self-hosted tarpit system designed to trap and waste the resources of non-compliant AI crawlers. Created by Aaron (zadzmo), it generates procedurally infinite, nonsensical web pages filled with Markov chain text and endless links. Compliant crawlers that honor `robots.txt` never see it; aggressive scrapers that ignore `Disallow` rules become trapped in an ever-expanding maze of garbage content.
|
**Nepenthes** is a lightweight, self-hosted tarpit system designed to trap and waste the resources of non-compliant AI crawlers. Created by Aaron (zadzmo), it generates procedurally infinite, nonsensical web pages filled with Markov chain text and endless links. Compliant crawlers that honor `robots.txt` never see it; aggressive scrapers that ignore `Disallow` rules become trapped in an ever-expanding maze of garbage content.
|
||||||
|
|
||||||
|
|
|
||||||
Loading…
Reference in New Issue
Block a user