Welcome to WebmasterWorld Guest from 54.163.40.152

Forum Moderators: goodroi

Message Too Old, No Replies

Is it a spider?

     

topher

5:22 am on Jun 8, 2004 (gmt 0)

10+ Year Member



Hi all,
I'm new at this, so pls forgive...
I noticed my server logs showing "hits" to an image that only is displayed when a customer's credit card is rejected by the gateway. In fact it is "hit" as much as main navigation images, and that might suggest a HUGE amount of rejections, but I doubt it.
Can spiders crawling my /images dir be the cause of this? Should I be diallowing spiders from /images?
thanks!

jdMorgan

5:38 am on Jun 8, 2004 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



> Can spiders crawling my /images dir be the cause of this?

Yes.

> Should I be disallowing spiders from /images?

It would seem a prudent thing to do. Better yet, organize your images into two directories: Those images that you'd like to use to get traffic from image searches, and those that wouldn't serve well as 'ads' for your site.
Disallow robots from spidering the non-beneficial images to save bandwidth and prevent problems interpreting your stats.

Jim

 

Featured Threads

Hot Threads This Week

Hot Threads This Month