llms.txt / AI Crawler Check
Inspect the site’s llms.txt guidance and how robots.txt treats common AI crawlers.
Need the whole picture?
Run Website CheckRun the DivisionDesk Website Auditor for site-wide scoring, prioritized findings, exact-fix guidance and intelligent sitemap data.