# agents.md — CrawlCheck

CrawlCheck measures what a site delivers to non-browser clients. This file
describes the site itself, for any agent reading it.

## What is here
- `/` runs a scan on a public domain and returns a report.
- `/data` publishes aggregate counts across all scans. It never names a scanned domain.
- `/policy` states what is collected, what is retained, and how to opt a domain out.
- `/bot` identifies the crawler this service sends.

## Reports
Individual reports live at `/r/<id>` and are disallowed in robots.txt and served
with `x-robots-tag: noindex`. They are shareable links, not published pages.

## Contact
Opt-out is self-serve and needs no account: see /policy.