Crawler
SEOFixAgentBot
If you found this address in your access logs, this is what it was. SEOFixAgentBot fetches a page when a signed-in person asks us to audit that page. It does not crawl continuously, it does not look for anything to index, and it never submits a form or follows a link behind a login.
What it requests
- The URL you enteredOne GET request. HTML only — no images, scripts, fonts or media.
- /robots.txtTo report whether crawlers are allowed, and to find your sitemap.
- /sitemap.xmlTo confirm it is reachable and parseable. Followed only for a site crawl.
- /llms.txtTo report whether the file exists and whether it follows the spec.
- Requests per audit
- Four or fewer
- Concurrency
- One request at a time, per audit
- Politeness delay
- 350 ms between pages during a site crawl
- Body size cap
- 3 MB
- Redirect cap
- 5 hops
- Continuous crawling
- None — every request is started by a signed-in person
The User-Agent strings we send
We send the first one. If a site answers it with a hard block — 401, 403, 405, 406, 429 or 503 — we retry once with the second, which is browser-shaped but still names us and still points here. We do not disguise ourselves: both strings identify the bot and both link to this page.
Default
Mozilla/5.0 (compatible; SEOFixAgentBot/1.0; +https://seofixagent.com/bot)Retry, after a hard block
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/140.0.0.0 Safari/537.36 SEOFixAgentBot/1.0 (+https://seofixagent.com/bot)Allowing us
If you own the site and your audits are coming back blocked, allow any User-Agent containing SEOFixAgentBot. On Cloudflare that is a WAF skip rule; on most managed hosts it is an allowlist entry. Requests all originate from one address:
167.233.18.44
Turning us away
Add this to your robots.txt and we will stop. We read robots.txt on every audit and honour it — a blocked page is reported to the person who asked as blocked, and nothing further is fetched.
User-agent: SEOFixAgentBot
Disallow: /Something else wrong? The privacy policy lists the contact address, and we answer.