Citablecitable2.0AI SEARCH READINESSNo account needed

Clear evidence. Practical next steps.

Free robots.txt checker for AI search

Check how robots.txt rules apply to the exact page you enter. See search-tool permissions separately from training permissions, with evidence and practical next steps.

◎ For marketers⌘ For developers✧ For researchers

One page per domain report · Public HTTP(S) only · Cross-origin redirects are blocked; use the final website address.

Check access before changing robots.txt

A blocked search-tool rule can prevent that tool from crawling a page. An allowed rule is permission, not proof that a provider visited, indexed or cited you. Enter the final public page address; rules can differ between paths on the same website.

  1. Run the audit below. It fetches public discovery files and checks the selected page.
  2. Read the focused access result and the provider rules in Technical evidence.
  3. Review changes with your developer. Preserve restrictions for private paths and keep training permissions as a separate decision.

Example: a rule that disallows /private/ does not automatically disallow /articles/. More specific matching rules and Allow exceptions matter.

Unavailable or protected robots.txt remains unknown. Citable does not impersonate provider networks, execute website JavaScript or bypass access controls.

Read the official Google documentation ↗

This tool runs Citable's full eight-check audit and highlights the relevant check. No signup required during public beta.

FROM DISCOVERY TO TRUST

Why AI search visibility matters

When an AI answer cites your work, readers can follow the source to your website. Clear, accessible content makes your expertise easier to understand and verify.

Relevant visits

Help readers exploring your topic find the original page. Visits and conversions still need separate measurement.

Verifiable expertise

Give researchers clear facts, authorship and sources they can check. Publish evidence worth referencing.

A shared action plan

Connect marketing priorities with concrete technical tasks your developer can review.

Educational links, not integrations or endorsements. Citable checks your page; it does not query these services, measure actual citations or guarantee inclusion.

LET’S TALK

Contact us

Have a question, a confusing result or a suggestion? Tell us which page you checked and what you noticed.

Please do not send passwords, access keys or private customer information.

Contact form setup is pending.

Messages are private to the Citable team and retained for 90 days. This form does not send email.

WHAT THE SCORE MEASURES

Eight checks, with their limits visible.

AI search tool permissions 30 · Initial HTML text 15 · Metadata 15 · JSON-LD 15 · Sitemap 10 · Heading outline 5 · Canonical/social tags 5 · Optional llms.txt 5.

Unavailable resources remain unknown. An incomplete audit displays a possible score range. Short text does not prove JavaScript dependence. robots.txt is a permission signal; this scanner does not impersonate provider crawlers.

Free summary

Scores, check states, timestamp and measurement limits.

Paid details

Same immutable snapshot, full evidence, actions and downloadable drafts. Checkout opens only when configured.