AuditRadarBot
AuditRadarBot fetches publicly posted RFP pages at most once every 2 seconds per host and honours robots.txt. Contact support@getauditradar.com to exclude your site.
User agent
AuditRadarBot/1.0 (+https://getauditradar.com/bot)
What it does
- Fetches pages and documents that are publicly linked from an issuer's own site.
- Waits at least 2 seconds between requests to the same host.
- Reads and obeys robots.txt for its own user agent and for
*. - Accepts only HTML, PDF and plain text, and stops at 5 MB.
What it never does
- It never logs in, submits a form, or follows a paywall.
- It never collects personal data beyond what an RFP page itself publishes.
Exclusion
Email support@getauditradar.com and we will stop fetching your host, or add a robots.txt rule for AuditRadarBot.