What exactly is AiVIS Cite Ledger?

AiVIS Cite Ledger is an evidence-backed AI citation audit and remediation system. It measures how AI models, ChatGPT, Perplexity, Claude, and Google AI, interpret, trust, and cite your web content. The result is a 0–100 CITE LEDGER score across seven weighted dimensions, with BRAG evidence-linked findings and prioritized fixes.

How is this different from Semrush, Ahrefs, or Clearscope?

Traditional SEO tools optimize for keyword ranking in traditional search results. AiVIS Cite Ledger audits citation readiness, the specific signals that determine whether AI answer engines retrieve and cite your content. A page can rank #1 on Google and be completely invisible to AI answer synthesis.

What is BRAG and how does it make findings trustworthy?

BRAG stands for Based-Retrieval-Auditable-Grading. It ties every audit finding to a real, traceable element on your page, a specific heading, schema block, meta tag, or content section, each carrying a unique evidence ID. You can open the element, verify the finding, and recheck it after a fix. No black boxes.

Is the free tier genuinely useful, or just a teaser?

The Observer (free) plan gives you a full composite CITE LEDGER score and all seven dimension letter grades, so you can see exactly where you stand and which categories are hurting you. BRAG evidence IDs and prioritized fix packs require a paid plan. Three audits per month, no credit card.

Blocked by robots.txt - AI Can't Crawl You | AiVIS Cite Ledger

One line in your robots.txt can make your entire site invisible to AI models. Many security plugins and default configurations block AI crawlers silently.

AI-Specific User-Agents to Know

GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot (Perplexity), Googlebot (Google AI), and others each respect robots.txt rules for their user-agent.

A blanket 'User-agent: * / Disallow: /' blocks everything, including AI crawlers. More targeted blocks may only affect specific models.

How to Check Your robots.txt

Visit yourdomain.com/robots.txt and look for Disallow rules. Check for both wildcard rules (User-agent: *) and AI-specific blocks (User-agent: GPTBot).

Also check for noindex meta tags in your HTML, these tell crawlers to parse but not index, effectively hiding content from AI model training and citation.

Fixing robots.txt for AI

If you want AI visibility, explicitly allow AI crawlers. Add specific Allow rules for GPTBot, ClaudeBot, and PerplexityBot.

Keep blocking admin paths, login pages, and private content. AI visibility doesn't mean opening everything.

After updating robots.txt, run an AiVIS Cite Ledger audit to confirm AI crawlers can now reach your key content pages.

Frequently Asked Questions

Should I allow all AI crawlers in robots.txt?: Allow the ones you want citations from. For most businesses, allowing GPTBot, ClaudeBot, and PerplexityBot while blocking others based on your data policy works well.
Do AI crawlers respect robots.txt?: The major AI crawlers (GPTBot, ClaudeBot, PerplexityBot) respect robots.txt. Some smaller or training crawlers may not.
Can I block training but allow citations?: This is tricky. Currently, there's no standard robots.txt directive that distinguishes training from citation. Some providers support separate user-agents for different purposes.