1 service · 4 calls/30d · agent402.tools
agent402.tools
Fetch a site's robots.txt and answer: may this user-agent crawl this path? Returns the matched rule and all declared sitemaps.
