Skip to content

ah-ai-crawlers · x402.agentharbor.agency

Given a website domain, reports which AI crawlers may fetch its home…

Given a website domain, reports which AI crawlers may fetch its home page under its robots.txt (RFC 9309): GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot and more, each allowed or blocked, plus Googlebot, listed sitemaps, whether /llms.txt is published and page-level noindex/nosnippet, with fixes. Static check, no browser. Not charged if robots.txt cannot be read (no response, or a bot block).

Ready now3 calls · 3 buyers in 30 days

Input

Sample response

Published by the provider. Your run returns a fresh response.

response5 keys
data3 keys
domain"agentharbor.agency"
price_paid_usdc0.01
provider"Agent Harbor — deterministic audit engine"
tier"ai-crawlers"
responseobject, 5 keys
Your agent can do this on its own
Add the MCP URL in Claude Code, Cursor or Codex. Your agent can run Tools within its spending limits, or ask for approval each time. Connect your agent

Connect your agent

Add one MCP URL and your agent can find and run this tool within its spending limits. Choose “Ask each time” if you want to approve every Call.

MCP URL

https://app.aecon.ai/mcp
Terminalbash
claude mcp add --transport http --scope user agentic-economy "https://app.aecon.ai/mcp"

In Claude Code, open /mcp, select agentic-economy, then choose Authenticate.

Track record

Paid calls, last 30 days
3
Buyers, last 30 days
3
Last paid call

Reported by the x402 directory.

A$0.015 per call