hello
i am working on my project regarding clocking search engines for that i need some help more from you . i am looking for list of User-Agent and IP addresses of search engines if any one knows please provide me thank you .
hello
i am working on my project regarding clocking search engines for that i need some help more from you . i am looking for list of User-Agent and IP addresses of search engines if any one knows please provide me thank you .
IP addresses and User-Agent of the major search engines
Search: Google
Robot: Googlebot
User-agent: Googlebot/2.1 (+ http://www.google.com/bot.html) or
Mozilla/5.0 (compatible; Googlebot/2.1; + http://www.google.com/bot.html)
Hosts (DNS) : googlebot.com crawl **.
IP addresses : 66,249 .**.**
Search: MSN (Microsoft)
Robot: MSNBot
User-agent:
msnbot/1.0 (+ http://search.msn.com/msnbot.htm) or
msnbot/0.3 (+ http://search.msn.com/msnbot.htm)
Hosts (DNS) : msnbot.msn.com or IP address
IP addresses :207.68.146 .***
Hosts (DNS) : msnbot.msn.com or IP address
Hosts (DNS) : 65.54.188 .***
Search: Yahoo!
Robot: Yahoo! Slurp
User-agent:
Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
Hosts (DNS) : xxxxx.inktomisearch.com
IP addresses :66,196 .***.***
Hosts (DNS) :xxxxx.inktomisearch.com
IP addresses :68,142 .***.***
get all User-Agent and IP addresses of search engines. from here
Bookmarks