Welcome to WebmasterWorld Guest from 54.167.155.147

Forum Moderators: open

Message Too Old, No Replies

Hotbot.com?

Hotbot have no page rank!

   
9:40 pm on Jul 1, 2004 (gmt 0)

10+ Year Member



Hey guys, I have just checked that Hotbot.com don't have any page rank and not listed in google. Could you please tel me why?
5:15 am on Jul 3, 2004 (gmt 0)

10+ Year Member



easy question.

easy answer

check their robots.txt

*****

# No robot will spider the domain
User-agent: *
Disallow: /

*****

5:22 am on Jul 3, 2004 (gmt 0)

WebmasterWorld Senior Member ogletree is a WebmasterWorld Top Contributor of All Time 10+ Year Member



same as overture.
5:24 am on Jul 3, 2004 (gmt 0)

WebmasterWorld Administrator mack is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



In the UK it redirects and I see pr6

Mack.

10:55 am on Jul 3, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



easy answer

The robots.txt prevents Google from spidering and indexing the domain. Therefore, this page/domain is a dead end and PR is not passed. However, this page can receive PR (and it would be shown in the toolbar), i.e. this isn't the answer.

12:04 pm on Jul 3, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Until (very?) recently, the domain they used was hotbot.lycos.com. You might want to check if that one still has a better PR.
3:02 pm on Jul 3, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yeah, it redirects me to and I see pr6, but I am not in the UK (I am in the good all USA).
12:53 pm on Jul 5, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



LOL, the robots.txt is only in the .com and only on www.

[google.com...]

Quite a few old pages still hanhing around:
[google.com...]

12:06 pm on Jul 7, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just a note, it doesn't give you a PR0, it gives you a no ranking signal (a grey-bar) which might apply to the robots.txt theory.

Sid

1:21 pm on Jul 7, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The robots.txt file is mostly irrelevant to the PageRank calculation, btw. PageRank is derived from factors external to the page.