Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Is it a spider?

5:22 am on Jun 8, 2004 (gmt 0)

New User

10+ Year Member

joined:Feb 7, 2004
votes: 0

Hi all,
I'm new at this, so pls forgive...
I noticed my server logs showing "hits" to an image that only is displayed when a customer's credit card is rejected by the gateway. In fact it is "hit" as much as main navigation images, and that might suggest a HUGE amount of rejections, but I doubt it.
Can spiders crawling my /images dir be the cause of this? Should I be diallowing spiders from /images?
5:38 am on June 8, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
votes: 0

> Can spiders crawling my /images dir be the cause of this?


> Should I be disallowing spiders from /images?

It would seem a prudent thing to do. Better yet, organize your images into two directories: Those images that you'd like to use to get traffic from image searches, and those that wouldn't serve well as 'ads' for your site.
Disallow robots from spidering the non-beneficial images to save bandwidth and prevent problems interpreting your stats.



Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members