User-agent: * allows this page
How to fix it
Remove the blanket Disallow or add explicit Allow groups for crawlers you want.
Evidence
Confirmed. Documented by the search engine or AI operator itself.
- https://developers.google.com/search/docs/crawling-indexing/robots/intro
- https://www.rfc-editor.org/rfc/rfc9309
How it counts
- Weight: 10 (critical) × 1 (evidence tier), within the Crawlability & AI-bot access module, which carries 25% of the overall score.
- Pass counts fully, warn counts half, fail counts nothing.
- A confirmed, high-confidence failure of this check caps the overall score at 49.