Pricing

Rating

Developer

Actor stats

Categories

Share

AI Visibility & Bot Intelligence Suite - Dark Visitors Alternative

Comprehensive AI bot monitoring, robots.txt analysis, LLMs.txt generation, and AI shopping optimization. Monitor which AI crawlers visit your site, check AI compliance, generate AI-friendly configurations, and optimize for AI shopping agents.

Features

• AI Bot Directory - Comprehensive database of 38+ AI crawlers with user agents, operators, and categories
• Robots.txt Analysis - Check which AI bots are blocked or allowed by your robots.txt
• LLMs.txt Check - Verify if a site has an LLMs.txt file for AI context
• LLMs.txt Generator - Auto-generate optimized LLMs.txt content for your site
• AI Shopping Optimizer - Analyze e-commerce sites for AI shopping agent compatibility
• Competitor AI Audit - Compare AI visibility settings across competitor sites
• Bot Response Tester - Test how sites respond to different AI bot user agents

Quick Start

{
"urls":["https://example.com"],
"modules":["robotsTxtAnalysis","llmsTxtCheck"],
"demoMode":false
}

Demo Mode

Set demoMode: true to test with sample data (no charges, no actual network requests). Perfect for testing the output format before running real analysis.

{
"demoMode":true,
"urls":["https://example.com"],
"modules":["aiBotDirectory","robotsTxtAnalysis"]
}

Input Parameters

Available Modules

Bot Categories

Output Format

Robots.txt Analysis

{
"module":"robotsTxtAnalysis",
"url":"https://example.com",
"status":"completed",
"score":75,
"robotsTxtFound":true,
"robotsTxtUrl":"https://example.com/robots.txt",
"totalBotsChecked":38,
"botsBlocked":12,
"botsAllowed":26,
"aiBotsAnalysis":[
{
"botName":"GPTBot",
"userAgent":"GPTBot",
"operator":"OpenAI",
"category":"AI Assistant",
"isBlocked":true,
"matchedRule":"User-agent: GPTBot\\nDisallow: /"
}
],
"recommendations":[
"Consider allowing GPTBot if you want your content in ChatGPT responses"
]
}

LLMs.txt Check

{
"module":"llmsTxtCheck",
"url":"https://example.com",
"status":"completed",
"llmsTxtFound":false,
"llmsTxtUrl":"https://example.com/llms.txt",
"recommendations":[
"Create an LLMs.txt file to provide context for AI systems"
]
}

AI Bot Directory

{
"module":"aiBotDirectory",
"status":"completed",
"totalBots":38,
"categories":["AI Assistant","AI Search Crawler","AI Data Scraper"],
"bots":[
{
"name":"GPTBot",
"userAgent":"GPTBot",
"operator":"OpenAI",
"category":"AI Assistant",
"description":"OpenAI's web crawler for ChatGPT",
"respectsRobotsTxt":true,
"documentationUrl":"https://platform.openai.com/docs/gptbot"
}
]
}

AI Shopping Optimizer

{
"module":"aiShoppingOptimizer",
"url":"https://example.com",
"status":"completed",
"score":65,
"platform":"shopify",
"structuredDataFound":true,
"schemaTypes":["Product","BreadcrumbList","Organization"],
"issues":[
"Missing detailed product descriptions for AI comprehension"
],
"recommendations":[
"Add FAQ schema for common product questions",
"Enhance product descriptions with AI-readable attributes"
]
}

AI Bot Database

The suite includes a comprehensive database of 38+ AI bots:

Webhook Integration (Zapier, Make, n8n)

Connect this actor to your automation workflows with webhook notifications.

Setup

{
"urls":["https://example.com"],
"modules":["robotsTxtAnalysis","llmsTxtCheck"],
"webhookUrl":"https://hooks.zapier.com/hooks/catch/xxx/yyy",
"webhookOnIssues":true,
"webhookOnLowScore":true,
"lowScoreThreshold":50
}

Webhook Payload

When triggered, the webhook receives:

{
"actorId":"ecvImN3D2jfsZaHdt",
"actorRunId":"abc123",
"status":"alert",
"alertType":"low_score",
"timestamp":"2025-01-22T10:00:00Z",
"summary":{
"urlsAnalyzed":5,
"modulesRun":2,
"averageScore":45,
"totalIssues":8,
"totalRecommendations":12
},
"alerts":[
{
"url":"https://example.com",
"module":"robotsTxtAnalysis",
"score":35,
"issues":5,
"message":"Low AI visibility score: 35% (threshold: 50%)"
}
],
"datasetUrl":"https://api.apify.com/v2/datasets/xxx/items"
}

Alert Types

Integration Examples

Zapier: Use "Webhooks by Zapier" trigger with "Catch Hook"

Make (Integromat): Use "Webhooks" module with "Custom webhook"

n8n: Use "Webhook" trigger node

Custom: POST endpoint receives JSON payload

Pricing

This actor uses pay-per-event billing:

Example costs:

• Analyze 10 URLs with 2 modules each: 10 × $0.03 + 20 × $0.01 = $0.50
• Generate LLMs.txt for 5 sites: 5 × $0.05 = $0.25

Demo mode is free (no charges).

Use Cases

• AI Compliance Audit - Check if your robots.txt properly manages AI crawler access
• LLMs.txt Implementation - Generate and validate LLMs.txt files for AI context
• Competitive Analysis - Compare how competitors handle AI bot access
• E-commerce AI Readiness - Optimize product pages for AI shopping agents
• AI Visibility Monitoring - Track which AI bots can access your content
• SEO for AI - Ensure your content is discoverable by AI-powered search engines

Comparison: Dark Visitors vs AI Visibility Suite

Built by John Rippy | johnrippy.link

2025 Zapier Automation Hero of the Year - Project Phoenix: A 95-step AI sales pipeline cutting development time by 50%.

Actor Arsenal