Hey guys, I have just checked that Hotbot.com don't have any page rank and not listed in google. Could you please tel me why?
5:15 am on Jul 3, 2004 (gmt 0)
check their robots.txt
# No robot will spider the domain User-agent: * Disallow: /
5:22 am on Jul 3, 2004 (gmt 0)
same as overture.
5:24 am on Jul 3, 2004 (gmt 0)
In the UK it redirects and I see pr6
10:55 am on Jul 3, 2004 (gmt 0)
The robots.txt prevents Google from spidering and indexing the domain. Therefore, this page/domain is a dead end and PR is not passed. However, this page can receive PR (and it would be shown in the toolbar), i.e. this isn't the answer.
12:04 pm on Jul 3, 2004 (gmt 0)
Until (very?) recently, the domain they used was hotbot.lycos.com. You might want to check if that one still has a better PR.
3:02 pm on Jul 3, 2004 (gmt 0)
Yeah, it redirects me to and I see pr6, but I am not in the UK (I am in the good all USA).
12:53 pm on Jul 5, 2004 (gmt 0)
LOL, the robots.txt is only in the .com and only on www.