VOOZH about

URL: https://apify.com/dltik/geo-site-audit

⇱ AI Readiness Site Audit - robots.txt, llms.txt, Schema Β· Apify


πŸ‘ GEO Site Audit - AI Readiness Checker avatar

GEO Site Audit - AI Readiness Checker

Pricing

from $10.00 / 1,000 page auditeds

Go to Apify Store

GEO Site Audit - AI Readiness Checker

Audit your website for AI crawler accessibility: robots.txt (GPTBot, ClaudeBot, Perplexity), llms.txt, sitemap, Schema.org, meta tags, content extractability, TTFB. Get an AI-readiness score 0-100 with prioritized recommendations.

Pricing

from $10.00 / 1,000 page auditeds

Rating

5.0

(1)

Developer

πŸ‘ Walid

Walid

Maintained by Community

Actor stats

5

Bookmarked

30

Total users

7

Monthly active users

12 days ago

Last modified

Share

GEO Site Audit β€” AI Readiness Checker

GEO Site Audit scans your website and tells you exactly why AI assistants like ChatGPT, Perplexity, and Claude may be ignoring it. In under 30 seconds, get an AI readiness score (0–100) across 8 technical checks β€” from robots.txt to Schema.org β€” with a prioritized action plan to fix every issue.

No API key required. Paste your URL and click Start.

⭐ Found this useful? Click the Bookmark button at the top of this page β€” it helps the scraper stay visible to others who need it. Takes 1 click. No signup beyond your existing Apify account.


What can GEO Site Audit check on your website?

  • πŸ€– AI bot access β€” Are GPTBot, ClaudeBot, PerplexityBot, and Google-Extended allowed in your robots.txt?
  • πŸ“„ llms.txt β€” Does your /llms.txt exist? It's the new robots.txt for LLMs.
  • πŸ—ΊοΈ Sitemap β€” Is there a valid sitemap.xml for AI crawlers to discover your pages?
  • 🏷️ Schema.org / JSON-LD β€” Do you have structured data types like Organization, FAQ, HowTo?
  • 🚫 Meta AI tags β€” Are noai or noimageai directives silently blocking AI systems?
  • πŸ“ Content extractability β€” Is your content server-rendered (SSR), or is it locked behind JavaScript that AI crawlers can't execute?
  • πŸ”’ HTTPS + HSTS β€” Is your site trusted and secure?
  • ⚑ TTFB β€” Does your server respond fast enough? AI crawlers time out slow servers.

What data does GEO Site Audit extract?

FieldDescription
overall_scoreAI readiness score 0–100
gradeLetter grade A–F
robots_txt.blocked_botsList of blocked AI bots
llms_txt.statusok / missing
schema_org.types_foundSchema types detected (Organization, FAQ...)
content_extractability.text_lengthExtractable characters
ttfb_msTime to first byte in milliseconds
recommendationsPrioritized action list with fix instructions

How to check if your site is ready for AI crawlers

  1. Create a free Apify account β€” no credit card required
  2. Open GEO Site Audit in Apify Store
  3. Enter your website URL (e.g. https://example.com)
  4. Click Start β€” the audit runs in under 30 seconds
  5. Review your score and recommendations β€” each issue comes with a specific fix
  6. Download your audit report in JSON or CSV

How much does GEO Site Audit cost?

$0.01 per page audited.

Pages auditedCost
1 page$0.01
10 pages$0.10
100 pages$1.00

The cheapest actor in the GEO Suite. Run it first β€” technical blockers prevent all other GEO efforts from working.

Costs are charged via Apify Pay-Per-Event. You only pay for what you use. No monthly subscription.


Input

ParameterTypeRequiredDefaultDescription
urlstringβœ…β€”Full URL to audit (e.g. https://example.com)
maxPagesinteger❌1Number of pages to audit

Output example

{
"_type":"geo_site_audit",
"url":"https://example.com",
"overall_score":76,
"grade":"B",
"checks":{
"robots_txt":{
"score":100,
"status":"ok",
"details":"All major AI bots are allowed",
"allowed_bots":["GPTBot","ClaudeBot","PerplexityBot","Google-Extended"]
},
"llms_txt":{
"score":0,
"status":"missing",
"recommendation":"Create /llms.txt with a Markdown summary of your site. See llmstxt.org for the format."
},
"schema_org":{
"score":60,
"types_found":["Organization","WebSite"],
"types_missing":["FAQ","HowTo","Article"],
"recommendation":"Add FAQ schema markup to your key landing pages."
},
"content_extractability":{
"score":80,
"text_length":3240,
"text_html_ratio":0.18,
"h1_count":1,
"h2_count":6
},
"ttfb_ms":420
},
"recommendations":[
{"priority":1,"check":"llms_txt","action":"Create /llms.txt summarizing your site for AI."},
{"priority":2,"check":"schema_org","action":"Add FAQ and HowTo JSON-LD to your top pages."}
]
}

Use GEO Site Audit via API

With Apify's API, you can trigger audits programmatically, integrate into your CI/CD pipeline, or schedule weekly checks.

Python:

import requests
run = requests.post(
"https://api.apify.com/v2/acts/dltik~geo-site-audit/runs",
headers={"Authorization":"Bearer YOUR_APIFY_TOKEN"},
json={"url":"https://example.com"}
).json()
print(run["data"]["id"])# run ID to fetch results

curl:

curl-X POST "https://api.apify.com/v2/acts/dltik~geo-site-audit/runs"\
-H"Authorization: Bearer YOUR_APIFY_TOKEN"\
-H"Content-Type: application/json"\
-d'{"url": "https://example.com"}'

Schedule weekly AI readiness checks

Use Apify Schedules to automatically audit your site every week and get notified if your score drops. Connect to Slack, Zapier, or Make via webhooks to trigger alerts when issues are detected.


FAQ

Is this legal? Yes. GEO Site Audit only reads publicly accessible files (robots.txt, sitemap.xml, homepage HTML). No login, no credentials, no rate limiting issues.

My score is 76 but I still don't appear in ChatGPT. Why? Technical readiness is a prerequisite, not a guarantee. A score of 76 means AI crawlers can access your site β€” but content quality, authority, and brand mentions also determine if AI models reference you. Use GEO Visibility Score to measure actual AI mention rates.

What is llms.txt and why does it matter? /llms.txt is an emerging standard (similar to robots.txt) that gives AI systems a structured Markdown summary of your site. Perplexity and other AI crawlers are starting to prioritize sites that have it.

I got an error for my URL. What should I check? Make sure the URL starts with https:// and your site is publicly accessible. If behind a login or firewall, the audit cannot run.

Can I audit competitor sites? Yes β€” the audit only uses public data. Auditing competitors gives you a benchmark to compare your AI readiness score against theirs.

I need help or a custom solution. Open an issue on the Issues tab or contact us through Apify. We offer custom GEO auditing solutions for agencies.


⭐ Found GEO Site Audit useful? Bookmark it β€” Apify ranks actors by bookmarks, so it's the strongest signal for Store visibility. One click = directly helps this actor stay surfaced for new users.


Complete your GEO analysis with the full suite

ActorWhat it doesStart with this if...
βœ… GEO Site AuditTechnical AI readiness scoreAlways start here
πŸ“Š GEO Visibility ScoreGEO Score, mention rate, citation rateYou want your baseline AI visibility
βš”οΈ GEO Competitor ResearchShare of Voice vs competitorsYou know which competitors to track
πŸ” GEO Prompt ResearchAI keyword research & prompt scoringYou want to find new AI ranking opportunities
πŸ’¬ GEO Brand SentimentHow AI models describe your brandYou want to understand AI brand perception

You might also like

AI Readiness Auditor

rationalistic_counsel/ai-readiness-auditor

Check how AI-ready any website is. Get an AI Readiness Score (0-100) checking llms.txt, robots.txt AI crawler directives, Schema.org structured data, and meta tags. No API key needed.

AI Readiness Checker - Website Scanner

alizarin_refrigerator-owner/ai-readiness-checker

Analyze any website for AI optimization readiness. Check robots.txt, llms.txt, structured data, meta tags & content quality. Get actionable recommendations to improve AI crawler accessibility.

Robots Txt Audit

apage/robots-txt-audit

Audit robots.txt files for AI crawler access. Get an AI Readiness Score (0-100), analyze 61+ AI crawlers (ChatGPT, Claude, Perplexity, Gemini), detect syntax errors, security concerns, and get actionable recommendations. Batch audit multiple domains at once with optional subdomain scanning.

GEO Auditor β€” AI Search Readiness & Citability Audit

foxlabs/geo-auditor

Audit how ready your site is to be found, read & cited by AI search (ChatGPT, Perplexity, Gemini, Claude). Checks AI-crawler access, structured data, content extractability, speed & trust β€” scored 0-100 with a prioritized fix list. GEO / AEO technical audit.

2

Ai Visibility Suite - Dark Visitors Alternative

alizarin_refrigerator-owner/ai-visibility-suite---dark-visitors-alternative

Comprehensive AI bot monitoring, robots.txt analysis, LLMs.txt generation & AI shopping optimization. Monitor AI crawlers visits, check AI compliance, generate AI-friendly configurations, and optimize for AI shopping agents. AI Bot Directory Robots.txt LLMs.txt AI Shopping Competitor AI Audit

Geo AI Audit Scraper

canadesk/geo-ai-audit-scraper

Analyze website readiness for Generative AI search engines and get instant insights.

πŸ‘ User avatar

Canadesk Support

2

robots.txt Parser & AI Crawler Block Checker

taroyamada/robotstxt-ai-checker

robots.txt parser that audits AI crawler block rules (GPTBot, ClaudeBot, anthropic-ai, PerplexityBot) across thousands of websites in one run. Returns per-bot allow/disallow disposition and crawl-delay.

Robots.txt Checker - CMS-Aware Analysis with AI Recommendations

alizarin_refrigerator-owner/robots-txt-checker

The Robots.txt Checker provides comprehensive analysis of your robots.txt file: Syntax Validation CMS Detection - Identify WordPress, Shopify, Drupal,& 6+ other CMS platforms Best Practice Check Companion File Checks - sitemap.xml, llms.txt, security.txt AI Recommendations - CMS-specific suggestions

llms.txt Generator - Make Your Site AI-Discoverable

dltik/llms-txt-generator

Generate a standards-compliant llms.txt file for any website. Crawls your sitemap, extracts page titles & descriptions, groups them into sections, and outputs a clean llms.txt that helps ChatGPT, Claude, Gemini & Perplexity understand your site. Optional AI enrichment.