Back to Browse Sign in to download
Agent SkillDevOps & Cloud
Robots Sitemap Validator
Validate robots.txt and XML sitemaps locally before deployment. Catch accidental crawl blocks, broken sitemap references, invalid URLs, and indexing conflicts without changing the live site.
robots.txtsitemapSEOvalidationindexingdevops
Robots Sitemap Validator
Detect common local robots.txt and sitemap.xml mistakes that can hurt crawling. This detector does not fetch, submit, or change live sites.
Workflow
- Run scripts/scan_robots_sitemap.py with a folder, files, or --stdin.
- Review findings by rule id, severity, file, and line.
- Treat missing sibling sitemap files as review flags when robots.txt references them.
Guardrails
- Read local files or stdin only.
- Do not fetch live URLs or submit sitemaps.
- Do not modify robots.txt or sitemap files.
Verification
Run python scripts/scan_robots_sitemap.py --help first. Then use a disposable folder to verify both outcomes:
- A
robots.txtcontainingUser-agent: *andDisallow: /must reportRSV001. - A
robots.txtwith an absoluteSitemap:URL plus a matching, well-formed localsitemap.xmlmust produce zero findings.
Commercial Terms
Price: $0 / 0 credits. Free commercial use for personal or internal team workflows. Do not resell or redistribute the package as-is.
Files4 skill files
0 GitHub stars
0 downloads
0 saved
Install via CLI
skillbazaar install robots-sitemap-validator --agent claudeSign in (free) to install skills with the CLI.
