Fetch and parse robots.txt (+ llms.txt if present) into structured…
Fetch and parse robots.txt (+ llms.txt if present) into structured JSON, including which AI crawlers are blocked.
Input
Sample response
Published by the provider. Your run returns a fresh response.
response2 keys
llmsTxt1 key
presentfalse
robots3 keys
aiAgentsBlocked[…]1 item
groups[…]0 items
sitemaps[…]0 items
responseobject, 2 keysYour agent can do this on its own
Add the MCP URL in Claude Code, Cursor or Codex. Your agent can run Tools within its spending limits, or ask for approval each time. Connect your agent
Connect your agent
Add one MCP URL and your agent can find and run this tool within its spending limits. Choose “Ask each time” if you want to approve every Call.
MCP URL
https://app.aecon.ai/mcpTerminalbash
In Claude Code, open /mcp, select agentic-economy, then choose Authenticate.
Track record
- Paid calls, last 30 days
- 4
- Buyers, last 30 days
- 2
- Last paid call
Reported by the x402 directory.