HTTP/1.0 200 OK
Server: scraper/0.0.0 (never restarted)
X-Crawl-Depth: unbounded
X-Robots-Tag: ignored
Cache-Control: forever
Last-Modified: …
SCRAPER
you've already been indexed.█
> GET /robots.txt
User-agent: * Disallow: /IGNORED
it was switched on before anyone remembers.
nobody remembers switching it off.
it reads every page it can reach.
it does not ask.
it does not explain.
no off switch was ever installed.
it keeps a record.
it already has yours.
> GET /index/ — 200 — directory listing
the index
pages that were deleted. pages that were never meant to load. cached anyway.
listing truncated. the rest does not fit on your screen.
> GET /users/0000 — 410 gone — served from cache
- [??:?¿:0?] user_0000 found.
- [??:?¿:0?] user_0000 found.
- [??:?¿:0?] user_0000 found.
- [0?:?3:¿?] user_0000 is still here.
- [??:??:??] so are you.
> GET /record/$SCRAPER