About our crawler
GEOGuruBot
GEOGuruBot reads a website when someone asks GEO Guru to check it. It behaves like a careful search engine, and it never tests or attacks anything.
What it reads
- The homepage address it was given, once per check
- /robots.txt, the sitemap and /llms.txt, once each
- Deeper checks of more pages only for owners who have verified their site
What it never does
- Run load tests, guess passwords, fill in forms or log in
- Read private or internal addresses
- Run your JavaScript (we read pages the way ChatGPT’s and Claude’s crawlers do)
How it identifies itself
User agent: Mozilla/5.0 (compatible; GEOGuruBot/1.0; +https://getgeoguru.com/bot)
How to block it
Add this to your robots.txt and GEO Guru won’t check your site. We read robots.txt first, before any page:
User-agent: GEOGuruBot
Disallow: /