Draft pending legal review. This text has not yet been checked by a lawyer and may change before it takes effect.
In short
- GEOScannerBot is the program behind GEO Scanner. It visits a website when someone asks us to check it.
- It follows your robots.txt file. It reads at most 1 page per second and at most 2 pages at a time.
- It does not train AI models and does not build a search index.
- To block it, add two lines to your robots.txt (see section 5). To have your site added to our do-not-scan list, use our opt-out page.
1. Who we are
1.1. GEOScannerBot is run by [ENTITY_NAME missing], the company behind GEO Scanner. GEO Scanner checks how ready a website is to be read and quoted by AI answer engines.
1.2. It identifies itself with this user agent:
GEOScannerBot/1.0 (+https://rankit.cc/bot)
1.3. In robots.txt, it answers to the name GEOScannerBot.
2. Why it visited your website
2.1. Someone typed your web address into GEO Scanner to check it. This may be you, someone on your team, an agency, or someone comparing websites.
2.2. If a customer added your website for monitoring, it may come back on a schedule, usually once a week and at most once a day.
2.3. It does not:
- collect content to train AI models;
- build a search index or a copy of the web;
- log in, fill in forms, click buttons that change things, or buy anything;
- try to find security holes.
3. How it behaves
3.1. It reads your robots.txt first, every time. robots.txt is a small file at the top of your website that tells visiting programs where they may go. We read it at the start of every scan, so changes apply to the next scan.
3.2. It follows the standard rules. We follow the robots.txt standard (RFC 9309). If you have rules for GEOScannerBot, we follow those. If you do not, we follow your rules for all bots (User-agent: *).
3.3. If you block it, it stops. If your robots.txt blocks GEOScannerBot from your homepage, we read nothing else from your site. We tell the person who asked that your site does not allow our scanner.
3.4. If your robots.txt is broken. If your robots.txt cannot be reached because of a server error, we treat your whole site as blocked. If it simply does not exist, we treat the site as open, as the standard says.
3.5. It is gentle.
- At most 2 pages at the same time, and at most 1 new page per second, for each website.
- A limited number of pages per scan: 10 on a free scan, up to 100 or 200 on paid plans.
- It skips pages larger than 3 MB and gives up on a page after 15 seconds.
- It follows at most 5 redirects.
- It connects only to normal web ports (80 for http and 443 for https).
3.6. It opens some pages in a browser. To see what a visitor sees, it opens your homepage and a few other pages in a hidden browser (Chromium) and takes screenshots. Your pages' own scripts run in that browser, so a visit may show up in your own analytics. Each page starts in a fresh, empty browser session. We do not accept cookie banners or sign up for anything.
3.7. It reads, but does not copy your whole site. We keep page copies and screenshots for 7 days, then delete them. We keep the score, the findings and short pieces of evidence, such as a page title, with the scan result.
3.8. It checks what your robots.txt says about AI crawlers. Part of our report shows whether your robots.txt allows AI crawlers such as GPTBot or ClaudeBot. We work this out by reading your robots.txt. We never visit your site pretending to be those crawlers.
4. Personal data on your pages
If your pages show personal data, such as staff names or contact details, our scanner may read it as part of the page. We do not look for it on purpose, we do not use it to contact anyone, and we do not sell it. Our Privacy Policy explains more, including your rights.
5. How to block GEOScannerBot
5.1. To block it from your whole website, add these lines to your robots.txt file:
User-agent: GEOScannerBot
Disallow: /
5.2. To block only some pages, list them:
User-agent: GEOScannerBot
Disallow: /private/
Disallow: /checkout/
5.3. The next scan will follow your new rules.
5.4. If you cannot change your robots.txt, or you want us to stop for good, use our opt-out page. We add your website to a list that our app will not scan, whoever asks.
6. Is it really us?
Anyone can copy a user agent. If you are not sure a visit came from us, email hello@rankit.cc with the date and time (with time zone), the IP address and the user agent from your logs. We will check and tell you.
7. Contact
Questions or problems with our scanner: hello@rankit.cc. Privacy questions: privacy@rankit.cc.