RSS Feed Parser
Parse RSS 2.0, RSS 1.0 and Atom feeds, normalise their dates and links, and see every problem a feed reader would trip over.
Read moreFree tools
Test what search engines and AI crawlers are allowed to fetch, and generate the files that tell them where to go.
Parse RSS 2.0, RSS 1.0 and Atom feeds, normalise their dates and links, and see every problem a feed reader would trip over.
Read moreValidated, correctly escaped sitemaps that follow the sitemaps.org protocol, ready to upload.
Read moreTrace how RewriteRule, RewriteCond and Redirect handle each URL before you put the rules on a live server.
Read moreSeparate the three questions people mix up: what robots.txt permits, what the server returns, and what the page says about…
Read moreCheck any path against the rules a crawler actually follows, using the precedence defined in RFC 9309.
Read moreBefore a page can appear in search results or AI answers, a crawler has to be allowed to fetch it and has to be able to find it. The tools in this category test the files and rules that control that: robots.txt, AI crawler access, server rewrite rules, XML sitemaps and RSS feeds.
Crawling and indexing are different things. A robots.txt rule decides whether a crawler may request a URL; it does not remove a page from search results, which is what a noindex directive does. These tools keep the two separate in their results, so you can tell which control is actually affecting a page.
Free strategy session
Tell us where you want the business to be in twelve months. We will come back with a costed plan, a realistic timeline, and the numbers we expect to move — no obligation, no jargon.
Talk to a developer
Not a sales team
Free strategy session
Tell us where you want the business to be in twelve months. We will come back with a costed plan, a realistic timeline, and the numbers we expect to move — no obligation, no jargon.
Talk to a developer
Not a sales team
show prices in USD?