Help Centre
What AI assistants may do with this site
The named agents, the difference between a bulk crawler and a fetch somebody is waiting for, and the paths none of them get.
Applies to Novus Learn 0.1.0
A policy a person can read
Copy linkThe crawl rules have always been machine-readable. The AI access page is the same policy written for a person deciding whether they may quote this site, and it is generated from the same module the robots rules are, so the two cannot disagree.
Two kinds of agent
Copy linkBulk crawlers read the site to build an index or a training corpus. User-initiated fetchers read one page because a person asked a question and is waiting for the answer. The rules treat them differently, because the second is a reader being served and the first is not.
The request, not the restriction
Copy linkThis site publishes educational material assembled from openly licensed public sources. Being readable by an assistant is close to the point of it. So the policy asks for attribution rather than forbidding access, and the handful of withheld paths are withheld because there is nothing useful at them: device-local pages that read your browser's own storage and return nothing to anybody else.