🤖 AI SEO Optimizer

🔌 API Overview (Tiered Access)

REST API access with tiered rate limiting. Free tier allows 10 API calls/day for testing. Pro tier provides unlimited access.

• POST /api/v1/analyze - Analyze robots.txt and AI bot configuration
• POST /api/v1/ssr - Check SSR compatibility
• POST /api/v1/schema - Validate Schema.org markup
• POST /api/v1/full-analysis - Complete AI SEO analysis
• GET /api/v1/docs - API documentation
• GET /health - Service health check (no rate limit)

Pro Authentication: Pass your Pro email in request body {"email": "your@email.com"} or header X-Pro-Email

📝 Request/Response Format

All requests use JSON. Most endpoints accept a url parameter.

// Request
POST /analyze
Content-Type: application/json
{
  "url": "example.com"
}

// Response
{
  "success": true,
  "url": "example.com",
  "robots_url": "https://example.com/robots.txt",
  "score": 85,
  "bots": [...],
  "recommendations": [...]
}

⚙️ Integration Examples

# Python
import requests
response = requests.post(
    'https://jediwebservices.com/tools/ai-seo-optimizer/analyze',
    json={'url': 'example.com'}
)
print(response.json())

# JavaScript/Node.js
const response = await fetch(
    'https://jediwebservices.com/tools/ai-seo-optimizer/analyze',
    {
        method: 'POST',
        headers: {'Content-Type': 'application/json'},
        body: JSON.stringify({url: 'example.com'})
    }
);
const data = await response.json();

# cURL
curl -X POST https://jediwebservices.com/tools/ai-seo-optimizer/analyze \
  -H "Content-Type: application/json" \
  -d '{"url":"example.com"}'

🔒 Rate Limiting & Security

• API Free Tier: 10 API calls/day per IP
• API Pro Tier: Unlimited API calls
• Web UI: 50 analyses/day (separate from API limits)
• Burst Protection: 30 requests/minute per IP
• SSRF Protection: Private IP ranges blocked
• Input Validation: All inputs sanitized for XSS/injection

Response Headers: Check X-API-Remaining and X-API-Limit to monitor your usage.

🔔 Webhooks (Pro Feature)

Receive real-time notifications when monitored sites change scores.

• HMAC-SHA256 signature verification
• Automatic retry with exponential backoff
• Events: score_change, alert_triggered, report_generated

🤖 AI Bot Coverage (21 Bots Tracked)

We track all major AI crawlers and their relationships:

• OpenAI: GPTBot (ChatGPT), ChatGPT-User, OAI-SearchBot
• Anthropic: anthropic-ai, ClaudeBot, Claude-Web
• Google: Google-Extended (Gemini/Bard training)
• Perplexity: PerplexityBot
• Other AI: cohere-ai, Bytespider (TikTok), FacebookBot (Meta AI), Applebot-Extended, CCBot (Common Crawl), Omgilibot, Diffbot, YouBot, Amazonbot
• Search: Googlebot, Bingbot (always allowed for search visibility)

📊 Scoring Methodology

Our AI SEO score is calculated based on multiple factors:

• robots.txt Configuration (40%): Are AI bots explicitly allowed? Are there conflicting rules?
• SSR Compatibility (25%): Can bots read content without JavaScript execution?
• Schema.org Implementation (20%): Is structured data present and valid?
• AI Readability (15%): Content structure, heading hierarchy, semantic HTML

📝 llms.txt Standard

The emerging llms.txt standard (similar to robots.txt but for LLMs) allows you to:

• Provide a human-readable description of your site for AI
• List important pages AI should prioritize
• Specify content licensing and citation preferences
• Include contact info and branding guidelines

Place at: https://yoursite.com/llms.txt or https://yoursite.com/.well-known/llms.txt

🔧 Common Issues & Fixes

• Cloudflare Bot Fight Mode: May block legitimate AI bots. Whitelist by User-Agent.
• React/Vue/Angular SPAs: Implement SSR or pre-rendering for AI crawlers.
• Overly Restrictive robots.txt: Many sites have legacy "Disallow: /" rules affecting new AI bots.
• Missing Structured Data: At minimum, implement Organization, LocalBusiness, or WebSite schema.
• JavaScript-Rendered Meta Tags: Ensure critical metadata is in initial HTML response.

📈 Monitoring & Alerts

Set up automated monitoring to track changes:

• Daily/Weekly/Monthly scans of all your properties
• Score threshold alerts when AI accessibility drops
• Competitive tracking to monitor competitor AI SEO
• Email notifications for critical issues

📄 White-Label Reports (Pro)

Generate branded PDF reports for your clients:

• Add your agency logo and brand colors
• Customize company name and contact info
• Professional PDF export with executive summary
• Include/exclude specific sections as needed
• Perfect for client deliverables and audits

📊 Bulk Analysis (Pro)

Analyze multiple client sites simultaneously:

• Upload CSV or paste multiple URLs (up to 100 sites)
• Parallel processing for fast results
• Export results as CSV/JSON for spreadsheets or tools
• Comparison view across all client properties
• Track changes over time with historical data

🔔 Automated Monitoring

Set up automated checks for client sites:

• Schedule daily, weekly, or monthly scans
• Receive alerts when scores drop below thresholds
• Weekly summary emails with all client statuses
• Proactive alerts before clients notice issues

💼 Client Presentation Tips

How to present AI SEO value to clients:

• Lead with numbers: "40% of searches now involve AI" (Gartner 2024)
• Show the risk: Run their competitors' scores alongside theirs
• Make it tangible: Ask ChatGPT to recommend businesses in their industry
• Quantify the opportunity: Voice search and AI assistant market growth
• Easy wins first: robots.txt fixes take 5 minutes and show immediate results

💰 Pricing Your AI SEO Services

Suggested service packaging:

• AI SEO Audit: One-time comprehensive analysis ($200-500)
• Monthly Monitoring: Ongoing checks + alerts ($50-150/mo)
• Implementation: Fix robots.txt, add schema, etc. ($300-800)
• Full AI SEO Package: Audit + fixes + monitoring ($500-1500 setup + monthly)