MetaTagAuditorBot
How the Meta Tag Auditor crawler behaves when it visits your site.
User agent
Requests identify themselves with this user agent string:
MetaTagAuditorBot/1.0 (+https://metatagauditor.com/bot)How it behaves
- The site crawler obeys robots.txt.
- A single-URL check you run yourself fetches only the page you give it.
- It makes one request at a time per host, with a 500 ms minimum delay between requests.
- It never bypasses bot protection. If your site blocks us, we report that the site blocked the check and stop.
How to block it
Add this to your robots.txt:
User-agent: MetaTagAuditorBot
Disallow: /You can also block the user agent string at your server or firewall.