Pricing
from $10.00 / 1,000 results
AI Readiness Auditor
Check how AI-ready any website is. Get an AI Readiness Score (0-100) checking llms.txt, robots.txt AI crawler directives, Schema.org structured data, and meta tags. No API key needed.
Pricing
from $10.00 / 1,000 results
Rating
0.0
(0)
Developer
Actor stats
0
Bookmarked
16
Total users
1
Monthly active users
3 months ago
Last modified
Categories
Share
Check how AI-ready any website is. Get an AI Readiness Score (0-100) with actionable recommendations.
No API key needed. Just enter a URL.
What it checks
| Check | Weight | What it measures |
|---|---|---|
| llms.txt | 30% | /llms.txt and /llms-full.txt — the new standard for delivering content to AI assistants |
| robots.txt AI Directives | 25% | Permissions for GPTBot, ClaudeBot, Google-Extended, Amazonbot, PerplexityBot, and 9 more AI crawlers |
| Schema.org Structured Data | 25% | JSON-LD, Microdata, and RDFa markup that helps AI understand your content semantically |
| Meta Tags | 20% | Title, description, Open Graph, Twitter Card, canonical URL, language declaration |
AI Readiness Score grading
| Grade | Score | Meaning |
|---|---|---|
| A+ | 90-100 | Fully optimized for AI — your content is maximally discoverable |
| A | 80-89 | Excellent — minor improvements possible |
| B | 70-79 | Good — some AI optimization gaps |
| C | 60-69 | Average — significant room for improvement |
| D | 50-59 | Below average — missing key AI signals |
| F | 0-49 | Not AI-ready — major changes needed |
Why AI readiness matters
In 2025-2026, how AI systems discover and use your content is becoming as important as traditional SEO:
- AI search engines (Perplexity, Google AI Overviews, ChatGPT Search) now drive significant traffic
- LLM agents (Claude, GPT, Gemini) are used by millions to find and evaluate products, services, and information
- llms.txt is a new standard (like robots.txt was for search engines) that tells AI how to consume your content
- Websites blocking AI crawlers lose visibility in AI-powered search results
- Schema.org markup helps AI understand what your page is about, not just what it says
Input
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
urls | string[] | Yes | — | Website URLs to audit (e.g., https://example.com) |
checkLlmsTxt | boolean | No | true | Check /llms.txt and /llms-full.txt |
checkRobotsTxt | boolean | No | true | Check robots.txt AI crawler directives |
checkStructuredData | boolean | No | true | Check Schema.org structured data |
checkMetaTags | boolean | No | true | Check meta tags quality |
timeout | integer | No | 30 | HTTP request timeout (seconds) |
Output
Each URL produces a result with:
| Field | Type | Description |
|---|---|---|
url | string | The audited website URL |
aiReadinessScore | integer | Overall score 0-100 |
grade | string | Letter grade (A+ through F) |
llmsTxt | object | llms.txt check results (score, exists, findings) |
robotsTxt | object | robots.txt AI directives (score, crawler permissions, findings) |
structuredData | object | Schema.org analysis (score, JSON-LD count, schema types, findings) |
metaTags | object | Meta tags analysis (score, title, description, OG/Twitter, findings) |
recommendations | string[] | Prioritized actionable recommendations |
auditedAt | string | ISO 8601 timestamp |
Example output
AI crawlers checked
The actor checks permissions for these AI crawlers in robots.txt:
| Crawler | Operator |
|---|---|
| GPTBot | OpenAI |
| ChatGPT-User | OpenAI |
| ClaudeBot | Anthropic |
| Claude-Web | Anthropic |
| Google-Extended | Google (Gemini) |
| Amazonbot | Amazon |
| PerplexityBot | Perplexity AI |
| YouBot | You.com |
| CCBot | Common Crawl |
| Bytespider | ByteDance |
| Cohere-ai | Cohere |
| FacebookBot | Meta |
| anthropic-ai | Anthropic |
| Applebot-Extended | Apple |
Use cases
- SEO professionals: Audit client websites for AI search readiness
- Web developers: Check your site before deploying AI optimization changes
- Digital marketers: Compare competitor AI readiness scores
- AI tool builders: Find websites with good structured data for training/indexing
- Consultants: Generate AI readiness reports for clients
FAQ
Q: Do I need an API key? A: No. This actor only reads publicly available files (llms.txt, robots.txt, HTML) from websites you specify.
Q: Is this legal? A: Yes. The actor only reads files that websites explicitly serve to all visitors (robots.txt, HTML pages). It respects the same access that any web browser has.
Q: How many URLs can I audit at once? A: Up to 100 URLs per run. Each URL is audited independently.
Q: What is llms.txt? A: A new standard (2025-2026) similar to robots.txt but for AI. It tells LLMs and AI agents how to consume your content. See llmstxt.org for details.
Q: Why does my site score low? A: Most websites haven't optimized for AI yet. Check the recommendations in the output for specific improvements.
Q: Does this check mobile or JavaScript-rendered pages? A: This actor uses HTTP requests (not a browser), so it checks the initial HTML response. JavaScript-rendered content may not be captured. For most sites, the key signals (llms.txt, robots.txt, meta tags, JSON-LD) are in the initial HTML.
Q: Can I run this on a schedule? A: Yes. Use Apify's scheduling feature to run periodic AI readiness audits and track improvements over time.
Q: How is the score calculated? A: The overall score is a weighted average: llms.txt (30%), robots.txt AI directives (25%), Schema.org structured data (25%), and meta tags (20%). Each check scores 0-100 independently.
