MCP Server
MCP
Scrape-LE
Analyse robots.txt content and report whether a path may be crawled.
Install
npx -y [email protected]
Configuration Example
{
"remotes": [],
"packages": [
{
"registryType": "npm",
"registryBaseUrl": "https://registry.npmjs.org",
"identifier": "scrape-le-mcp",
"version": "2.2.5",
"runtimeHint": "npx",
"transport": {
"type": "stdio"
}
}
]
}
mcp
model-context-protocol
npm
By
Comments
Sign in to leave a comment