Check page URLs against robots.txt using public robots and sitemap URLs or local files; sitemap indexes are followed automatically.
Useful to know
Are sitemap indexes followed?
Yes. Public and pasted indexes follow child sitemaps. If a child fails, results and download names are explicitly marked incomplete. The check supports up to 5,000 page URLs and 2,000,000 rule comparisons.
Is a blocked sitemap URL definitely an SEO error?
It is a potential conflict to review. Intentional blocking, a partial dataset or differing crawler policy can explain it. The tool cannot observe actual indexing.
Where are my files and inputs processed?
Pasted text and opened files are processed on your device. If you request a public sitemap or robots.txt URL, OnlineTools Kenya receives that URL and downloads it through its server. Sitemap indexes also download their child URLs. The remote website sees server requests. This feature does not save document contents; hosting and security logs may retain request metadata. Passing an extracted URL list to another tool uses temporary browser-tab storage, expires after ten minutes, and is consumed when opened.
Rate this tool
Tell others how well Robots.txt & Sitemap Cross-Check worked for you. No account needed.