About RecomindoBot
RecomindoBot is the crawler of Recomindo, a service that shows whether AI assistants such as ChatGPT and Perplexity recommend a business. It reads a small number of public pages of one website to run an audit that someone requested.
Why did it visit your site?
Someone entered your domain in Recomindo: a free check or free tool, a customer setting up a business to track, or an agency preparing a report. The sites of registered customers are also re-read from time to time to keep their audit current. RecomindoBot does not roam the web and does not follow links to other websites.
What does it fetch?
- Your /robots.txt first. If it disallows RecomindoBot, we stop and read nothing else.
- Your homepage, and your /llms.txt and XML sitemap if you have them.
- A handful of key public pages of the same site (about, services, pricing, FAQ, contact): at most 10 pages and at most 20 requests in total.
- Only pages that your robots.txt allows, with at most 4 requests at a time. If your homepage answers 401, 403, 429 or 503, we stop at once and do not retry.
- Nothing else: no logins, no forms, no JavaScript execution, no images or files and no other websites. Pages are read as text, up to 2 MB each, over the standard web ports.
What happens to what it reads?
The text is analysed to write the audit, for example whether AI crawlers may read your site, and whether you have llms.txt, structured data and an FAQ. How we handle the data is described in our privacy policy. Privacy policy
How to recognise it
Every request carries this User-Agent header:
RecomindoBot/0.1 (+https://recomindo.com/bot; AI visibility audit)How do I block or limit it?
Add this to your robots.txt. RecomindoBot reads robots.txt before every audit, and to block only part of your site, replace / with that path.
User-agent: RecomindoBot
Disallow: /This only affects Recomindo's audits. It does not change what ChatGPT, Perplexity or Google can read, because they use their own crawlers.
Contact
If RecomindoBot caused a problem or you have a question, write to us and include your domain and the time of the request:
[FILL IN: contact email]