Forum Moderators: DixonJones

Message Too Old, No Replies

Spider Asking for Partial Page Name

         

davidm

11:08 pm on Apr 8, 2003 (gmt 0)

10+ Year Member



I have a new site of thousands of pages that's being extensively spidered by AltaVista this month. For about 2% of the pages it requests, it has only part of the name. "page.h" or "pag" for instance, instead of "page.html". And some of times, the name fragment is from another directory.

The page names come from lists of regular links on different simple static pages on my site. I've seen duplicate requests for the same pages so I know that the original links weren't correctly spidered. I can't detect any pattern to the links incorrectly spidered, so if anyone can shed any light on how this could happen, I'd like to know.

pendanticist

7:42 am on Apr 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to WebmasterWorld [webmasterworld.com] davidm.

Think - Stupid Spiders: msg #:3 [webmasterworld.com]

Pendanticist.

davidm

12:56 am on Apr 10, 2003 (gmt 0)

10+ Year Member



Thanks, Pendanticist. And I thought spiders were perfect.

I guess I'll have to give it a smack upside the head with a rolled up newspaper.