# Indexing is blocked by the X-Robots-Tag: noindex header sent on every # response, not by this file. Crawling is allowed on purpose: a crawler that # is refused the fetch never sees that header, and could then index the URL # without ever reading the page. Article URLs are unguessable and unlinked. User-agent: * Allow: /