MCPLow riskUnclaimed
crawl-readiness
Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
Grubbomaticgrubbomatic/crawl-readiness
server.json
{
"$schema": "https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json",
"name": "io.github.Grubbomatic/crawl-readiness",
"description": "Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.",
"repository": {
"url": "https://github.com/Grubbomatic/crawl-readiness-mcp",
"source": "github"
},
"version": "0.2.4",
"websiteUrl": "https://www.crawlreadiness.com/mcp",
"packages": [
{
"registryType": "npm",
"identifier": "crawl-readiness-mcp",
"version": "0.2.4",
"transport": {
"type": "stdio"
},
"environmentVariables": [
{
"description": "Free API key from https://www.crawlreadiness.com/dashboard. The four audit tools work without it; the three generators and get_monitor_trend need it.",
"format": "string",
"isSecret": true,
"name": "CRAWL_READINESS_API_KEY"
},
{
"description": "Override the API base URL. Only useful for testing against a preview deployment; defaults to https://www.crawlreadiness.com.",
"format": "string",
"name": "CRAWL_READINESS_API_BASE"
}
]
}
]
}Permissions
DeclaredDetected
Runs code—
nodeInstalls—
npm:crawl-readiness-mcp@0.2.4Runs install scripts—None
NetworkNoneNone
Needs credentials
CRAWL_READINESS_API_KEYCRAWL_READINESS_API_KEYOutside the workspace—None
Agent tools—None
Checks
Low risk · Nothing worth a warning was found.
Not reviewed by a person · Checked by rules; the model review is not switched on yet.
Versions
- #10.2.4latestOct 7, 2026
crawl-readinessOpen in Codeg