Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Blocking Content

         

triniflav

3:28 pm on Aug 19, 2005 (gmt 0)

10+ Year Member



How can I block certain content from my page from being spidered? Or should I say is it posiible to block some content from a page from being spidered?

Brett_Tabke

3:38 pm on Aug 23, 2005 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



[google.com...]

triniflav

7:31 pm on Aug 23, 2005 (gmt 0)

10+ Year Member



I know about the robot.txt file, that is to block the page. My question is about some content on the page. The robot.txt file blocks all content but I want some of the content blocked. Is that possible?

Terabytes

7:35 pm on Aug 23, 2005 (gmt 0)

10+ Year Member



I don't believe you can selectivly block content...perhaps a solution would be to create a picture of your text and post it like an image...it would look like text to the viewer, however the SE won't be able to include the text in it's index...due to it's inability to read the "picture"

just a thought...
Tera

Terabytes

7:41 pm on Aug 23, 2005 (gmt 0)

10+ Year Member



Perhaps there is a CSS solution to this also by hiding the content, however, that may lead to a penalty of some sort for trying to "pull a fast one" with the SE's...

Tera

jd01

7:47 pm on Aug 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I believe the picture is the best idea. I think you could also create an external javascript file that holds the information. AFAIK most SEs do not open JS files.

Justin

BigDave

7:48 pm on Aug 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Learn a scripting language and don't serve the part of your content that you do not want the spiders to see to anyone that connects to your site with a SE spider UA.

It is also called "cloaking". The search engines don't really like it when you do this as an attempt to improve your ranking. If you are comfortable with a human reviewer from Google looking at what you are cloaking, then you are probably okay, but you play that game at your own risk.

triniflav

9:14 pm on Aug 23, 2005 (gmt 0)

10+ Year Member



Thank you, I would use an image for now and work on the css style sheet.