Welcome to WebmasterWorld Guest from

Forum Moderators: mademetop

Message Too Old, No Replies

What will forcing cookies do to spiders?

Any effect



6:34 am on Jan 10, 2005 (gmt 0)

10+ Year Member


As the subject states, what will forcing cookies do to spiders, crawlers, bots,etc. My limited knowledge in this area is that (i) spiders don't use cookies, and therfore (ii) the 'results' of a cookie force will be unpredictable, leading to a possible penalisation, drop in PR,etc,etc.

What do you think?



6:54 am on Jan 10, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

The results of a cookie force are not unpredictable. Your pages simply will not get indexed.


9:40 am on Jan 10, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Most spiders will throw away the cookie and never use it.

So the real question is, what do you do when a non-cookied request comes in?

If you respond with a subset of the information you'd usually display, then that is all the spider ever sees or has to work with.

This is a commom technique for sites that need logon to access deeper data. WMW is an example.


7:04 pm on Jan 11, 2005 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

If you are using the Cookie for navigation, you are out of luck on indexing.

Featured Threads

Hot Threads This Week

Hot Threads This Month