Understanding User-Agent Strings

CCBot/1.0 (+http://www.commoncrawl.org/bot.html)