Our crawler

Our crawler identifies itself as LFGSitesAudit/1.0 (+https://lfgsites.com/bot). It reads public pages only, respects robots.txt, makes at most one request a second to any site, and fetches at most 25 pages for a full audit and 2 pages for a quick check.

To opt out, add this to your robots.txt and we will never fetch your site again:

• User-agent: LFGSitesAudit
• Disallow: /

Or email team@lfgsites.com with your domain and we will add it to our exclusion list the same day.