Portfolios
Domain investors
Confirm that parked and for-sale names still resolve, redirect where you think they do, and aren't about to drop. Paste a batch, sort by days left, export the CSV.
Portfolio workflowFree domain checker, now in beta
Catch the broken redirect before it costs you a month of traffic.
Paste up to ten domains. Robotto follows every redirect, reads robots.txt the way crawlers do, tests whether AI bots can get in, and pulls the expiry date from the registry. You get one table back.
- 4 redirect chains
- Canonical host
- robots.txt
- AI crawler access
- Sitemap
- HTTPS
- RDAP expiry
- TTFB
- noindex
Results
| Domain | Canonical | robots.txt | AI crawlers | Sitemap | HTTPS | Expiry | Speed | Indexing | Details |
|---|
ok fine warn worth a look fail fix soon info no verdict
Checked before in this browser
What one pass covers
Ten checks, the ones that actually move traffic
Each domain gets about two dozen requests from our Worker. Nothing is guessed from a cached database: the answers come from your server, your DNS and your registry, right now.
-
Redirects and the canonical host
We request http and https, with and without www, and record every hop. If the four versions don't end on the same address, you're splitting links and crawl budget between duplicates.
How the verdict works -
AI crawler access
See what your robots.txt tells GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot, and whether your CDN turns them away anyway.
Read more -
robots.txt
Status, size, a hash so you can spot edits, and a loud warning when the file blocks the whole site.
-
Domain expiry
The expiration date and registrar straight from RDAP, with days left. Under 30 days turns amber.
-
Speed
Time to first byte and full fetch time for the home page, plus how long the redirect chain adds.
-
Indexing blockers
A leftover noindex tag or X-Robots-Tag header from staging is one of the fastest ways to vanish from search.
-
Sitemap
We follow the Sitemap line in robots.txt or try the usual paths, and check that the answer is a real sitemap.
-
HTTPS
Whether the https version completes a trusted TLS handshake, and whether it sends HSTS.
New for 2026
Your robots.txt says yes. Your firewall might say no.
Plenty of sites now block AI crawlers without anyone deciding to. A CDN setting flips, a security plugin ships a new rule list, a template copies someone else's robots.txt. If you want to show up in AI answers, or you want to stay out of training sets, you need to know what is actually happening.
Robotto reads your robots.txt rules for five common AI crawler tokens, then requests your home page twice: once as itself and once with an AI crawler's user agent. When the second request gets a 403 and the first doesn't, something at the edge is blocking AI bots.
| Crawler | robots.txt | Edge test |
|---|---|---|
| GPTBot | blocked | 403 |
| ClaudeBot | allowed | not sent |
| PerplexityBot | allowed | not sent |
| Google-Extended | allowed | no own bot |
| CCBot | blocked | not sent |
Who it's for
Made for people with more domains than they can eyeball
Clients
SEO agencies
Run a first-pass technical audit on a prospect's domains in a minute. Redirect splits, noindex leftovers and robots.txt blocks show up before the sales call.
Agency workflowNetworks
Site networks
When you run dozens of small sites from shared templates, one bad deploy breaks all of them the same way. A ten-domain spot check finds the pattern fast.
Network workflowComing soon
Scheduled monitoring with email alerts
Daily checks on your whole portfolio, an email when a status code, robots.txt or redirect changes, and expiry reminders at 30, 15, 7 and 2 days. We're building it now and want a few early users to shape it.
Ask for early accessEmail contact@robotto.org
Guides
Fixes for the problems the checker finds
-
01
Ten robots.txt mistakes that quietly kill traffic
A leftover staging rule, a blocked CSS folder, a file that returns your home page. Most robots.txt damage comes from a short list of mistakes.
5 min read
-
02
Letting AI crawlers in on purpose: a GEO checklist
Being cited in AI answers starts with letting the right crawlers read your pages. Here's how to choose which ones and check that your CDN agrees.
4 min read
-
03
www vs non-www: picking one and redirecting the rest
It barely matters which host you choose. It matters a lot that every other version redirects to it in one step.
4 min read
-
04
How to track domain expiry across a portfolio
Auto-renew fails more often than people think. A domain portfolio needs one list, one source of truth for dates, and a few deadlines you actually look at.
4 min read
-
05
Finding the pages you lost in a site migration
After a redesign or platform move, the traffic you lose is mostly on URLs nobody remembered. Here's how to rebuild the list and redirect what matters.
4 min read
-
06
How to read a redirect chain
Every hop in a redirect chain is a status code, a Location header and a decision someone made. Once you can read one, most redirect problems are easy to spot.
4 min read
Questions
Short answers
Is the checker really free?
Yes. Robotto is free while in beta, with no account and no card. Each visitor can check 30 domains a day so the service stays fast for everyone.
Do you store the domains I check?
No. The check runs on our Cloudflare Worker and the result goes straight back to your browser. Your browser keeps a copy so you can compare the next run with this one. We keep only a daily counter per visitor, stored as a scrambled value instead of your IP address.
What does the AI crawler check look at?
Two things. First, the rules in your robots.txt for GPTBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot. Second, whether your home page answers differently when the request carries an AI crawler's user agent, which is what happens when a CDN or firewall blocks those bots.
Will you email me when something changes?
Not yet. Scheduled monitoring with email alerts is the next thing we are building. Until then, run the checker again and it will show what changed since your last run in this browser. Write to contact@robotto.org if you want early access.