homepage Welcome to WebmasterWorld Guest from 54.198.224.121
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Website
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Toolbar and Robots.txt
rintrah




msg:1527676
 6:59 pm on Jun 5, 2003 (gmt 0)

The Google Toolbar is giving a page I've disallowed in my robots.txt a PR of 0.

Shouldn't the bar be grey? This is a page I do NOT want indexed, and I'm a little concerned.

FYI: robots.txt checks out fine, so its not a code issue.

 

jimbeetle




msg:1527677
 7:10 pm on Jun 5, 2003 (gmt 0)

There's a lot of strange stuff going on with the toolbar and PR lately. Read some of the other threads in this forum and you'll see many other posts on it. Problem is, there ain't any solid answers on it that are better than 'just sit back and see what happens.'

rintrah




msg:1527678
 7:11 pm on Jun 5, 2003 (gmt 0)

Yeah, I've noticed some weirdness with the TB as well, but this particular weirdness is something I've never encountered before.

Thanks for confirming my gut instinct of "doing nothing"

coconutz




msg:1527679
 7:27 pm on Jun 5, 2003 (gmt 0)

I've noticed that disallowed pages are sometimes displaying guestimated PR. I didn't think that this was the norm, for some reason I remember these pages having a gray bar. I came across this when searching for potential link partners, a disallowed links page is displaying PR6.

maybe it's time to uninstall this distraction

rintrah




msg:1527680
 7:35 pm on Jun 5, 2003 (gmt 0)

I'm seriously considering uninstalling my toolbar - and reinstalling maybe once a month for a quick check.

The results seem to be pretty arbitrary, and easily sows unecessary paranoia - I'm living proof of that. ;)

jimbeetle




msg:1527681
 7:44 pm on Jun 5, 2003 (gmt 0)

rintrah,

One thing I overlooked in my earlier post is that -- as JDMorgan put me straight on a couple of weeks ago -- if you do not want Google to index the page you have to allow G to see the page (pull the disallow entry out of your robots.tx) and use the robots meta tag (meta name="robots" content="noindex,nofollow" or as appropriate).

This is also needed for Teoma and ?ATW? that will insist on listing any page that they know is there whether robots.txt tells them they are allowed to index it or not.

Macguru




msg:1527682
 7:45 pm on Jun 5, 2003 (gmt 0)

Seems you got stuck in some kind of a loop.

[webmasterworld.com...]
[webmasterworld.com...]

Did you check if your pages where in the index before posting this?

>>The results seem to be pretty arbitrary, and easily sows unecessary paranoia - I'm living proof of that.

Please add contact info to your profile so we can bill you for the therapy.

rintrah




msg:1527683
 8:41 pm on Jun 5, 2003 (gmt 0)

Look for me mumbling and drooling in a corner.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved