Hey guys, I have just checked that Hotbot.com don't have any page rank and not listed in google. Could you please tel me why?
mars9820
5:15 am on Jul 3, 2004 (gmt 0)
easy question.
easy answer
check their robots.txt
*****
# No robot will spider the domain User-agent: * Disallow: /
*****
ogletree
5:22 am on Jul 3, 2004 (gmt 0)
same as overture.
mack
5:24 am on Jul 3, 2004 (gmt 0)
In the UK it redirects and I see pr6
Mack.
doc_z
10:55 am on Jul 3, 2004 (gmt 0)
easy answer
The robots.txt prevents Google from spidering and indexing the domain. Therefore, this page/domain is a dead end and PR is not passed. However, this page can receive PR (and it would be shown in the toolbar), i.e. this isn't the answer.
bird
12:04 pm on Jul 3, 2004 (gmt 0)
Until (very?) recently, the domain they used was hotbot.lycos.com. You might want to check if that one still has a better PR.
robotsdobetter
3:02 pm on Jul 3, 2004 (gmt 0)
Yeah, it redirects me to and I see pr6, but I am not in the UK (I am in the good all USA).
HitProf
12:53 pm on Jul 5, 2004 (gmt 0)
LOL, the robots.txt is only in the .com and only on www.