homepage Welcome to WebmasterWorld Guest from 50.17.107.233
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Robots.txt file
disallow target_blank
junior




msg:1528490
 3:58 pm on Dec 3, 2002 (gmt 0)

Hi everyone,

I'm working with a site which has an intelligence centre. Basically it is a database of news articles. There are about 750 to 1000 articles in the database with each article linking to the source website.

The PR of my client's site is low and I think it could be due to some of the outbound links to poor PR sites.

Does anyone know of a robots.txt file that will disallow robots from spidering outboud links which are contained within target_blank. And would disallowing a robot to follow these links make any difference at all.

Any help would be greatly appreciated.

Junior

 

Reflect




msg:1528491
 5:34 pm on Dec 3, 2002 (gmt 0)

The PR of my client's site is low and I think it could be due to some of the outbound links to poor PR sites

I do not think your outbound links would be the factor here. The way I understand outbound links they can only harm when pointing to a "bad site" or a site that has been banned/PR0d.

Brian

choster




msg:1528492
 9:06 am on Dec 5, 2002 (gmt 0)

That is not how robot.txt works. If this is really important to you, perhaps you could use Javascript that would open the outside links. Or depending on the type of sources, remove them altogether. You're not helping the user reading article about auto repair from the New York Times by linking to nytimes.com . On the other hand, if it's a sociology site and you're pointing to good but unknown sociology journal home pages, your users may be quite upset at the new imposition.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved