Search Engine USER AGENT Robot Info
 by Ian Cook

Search Engine USER AGENT Spider Info

{embed='se-news/.last_update'}

web_spider-100x100.png The following info is intended to assist you in identifying the search engine spiders that visit your site. Details are based on information you can obtain by viewing your site's visitor logs.

Use the User Agent to identify a particular search engine in your site's visitor logs, then use the Robots.txt Identifier in your robots.txt file if you'd like to block that spider from accessing parts of your site. For more information on blocking any of these spiders using your robots.txt file, see http://www.robotstxt.org/wc/exclusion.html.

Google Yandex
Yahoo Baidu Bing


Company Baidu Baidu
User Agent

Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
Mozilla/5.0 (compatible; Baiduspider+; +http://www.baidu.com/search/spider.html)
Mozilla/5.0 (compatible; Baiduspider-mobile; +http://www.baidu.com/search/spider.html)
Mozilla/5.0 (compatible; Baiduspider-image; +http://www.baidu.com/search/spider.ht...

TO READ THE FULL ARTICLE