Accessibility & indexing
HTTP responses, redirects, HTTPS, usable HTML, noindex, and snippet directives. Observed signals, with unknowns clearly marked.
Check whether your website is accessible to search and AI crawlers, discover technical issues, review structured data, and find opportunities to improve how your content can be discovered and understood.
Real technical checks. Clear findings. Actionable recommendations.
EntityRise fetches a small set of public website resources for this check. Page content is not stored permanently. Scans are not published as public report pages. Please submit public URLs without sensitive query parameters.
Know what is being checked
HTTP responses, redirects, HTTPS, usable HTML, noindex, and snippet directives. Observed signals, with unknowns clearly marked.
Path-specific robots.txt rules for ten published crawler identities. Search, training, and user retrieval are explained separately.
JSON-LD syntax and actual schema types, page metadata, headings, and a small set of HTML readability heuristics.
One discovered sitemap, canonical observations, and optional llms.txt. Missing optional files are not critical failures.
A technically ready website isn’t necessarily visible in AI recommendations. This single-page check cannot establish brand authority, content quality, E-E-A-T, provider access, actual indexing, or citation probability. Findings can change after the scan.
Read EntityRise’s methodology →Questions, answered
It inspects the submitted public page and a small set of supporting resources: robots.txt, one sitemap, and optional llms.txt. It reports deterministic technical findings with the inspected URL and evidence. It does not recursively crawl your website or execute its JavaScript.
No. Technical accessibility is only one part of discovery. This tool does not query AI assistants, measure recommendations, predict citations, or verify actual search indexing. The paid EntityRise audit tests approved buyer questions across five providers.
No. Search discovery and model training serve different purposes. You can restrict GPTBot or ClaudeBot for training while making an independent decision about search crawlers. Google-Extended does not control inclusion in Google Search. User-requested retrieval may also follow different rules.
llms.txt is optional; Google does not require new AI text files for AI Overviews or AI Mode. Relevant structured data can describe your content, but no schema type or file guarantees AI citations. The checker does not penalize a missing llms.txt.
Sites can time out, block automated access, serve challenges, or restrict our checker in robots.txt. Strict safety and response limits can also prevent inspection. An unknown result is not a failure and does not prove a provider cannot access your website.
Yes. No login, email, payment, or credits are needed. Website content is processed for the scan and is not permanently stored. Rate limits use short-lived hashed IP identifiers. Reports stay in your browser session and are not given public indexed URLs.
Purposes and robots behavior were checked against these sources on October 16, 2026.