About EvriNid
Evri is crawling public web content for a recommendation system (currently in a closed alpha) which can drive public interest to your web site.
Our crawler takes every precaution to avoid unduly loading a site, including rate limiting. The crawler also observers standard robots.txt protocol, so if you encounter problems, you may exclude portions of your site via the robots.txt file. For example if you would rather not have your /cgi-bin URLs crawled, you can add this to your site's robots.txt file:
User-agent: *
Disallow: /cgi-bin/
See http://www.robotstxt.org/robotstxt.html for additional details.
Additionally, you may contact us directly at evrinid@evri.com
Please include your contact information, an issue summary, and a complete example from your access logs.
Thank you,
Evri Operations