# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-Agent: * Disallow: /apfeeds/* Disallow: /api/ Disallow: /log/click* Disallow: /media/article* Disallow: /*referring_entity_uri=* Sitemap: http://www.evri.com/sitemap_index.xml