Welcome to WebmasterWorld Guest from 54.226.22.192

Forum Moderators: goodroi

Message Too Old, No Replies

Is it a spider?

     
5:22 am on Jun 8, 2004 (gmt 0)

New User

10+ Year Member

joined:Feb 7, 2004
posts:19
votes: 0


Hi all,
I'm new at this, so pls forgive...
I noticed my server logs showing "hits" to an image that only is displayed when a customer's credit card is rejected by the gateway. In fact it is "hit" as much as main navigation images, and that might suggest a HUGE amount of rejections, but I doubt it.
Can spiders crawling my /images dir be the cause of this? Should I be diallowing spiders from /images?
thanks!
5:38 am on June 8, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


> Can spiders crawling my /images dir be the cause of this?

Yes.

> Should I be disallowing spiders from /images?

It would seem a prudent thing to do. Better yet, organize your images into two directories: Those images that you'd like to use to get traffic from image searches, and those that wouldn't serve well as 'ads' for your site.
Disallow robots from spidering the non-beneficial images to save bandwidth and prevent problems interpreting your stats.

Jim

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members