Forum Moderators: open

Message Too Old, No Replies

Yahoo slurp spider confused.

         

idf03

9:56 am on Jul 20, 2004 (gmt 0)



Yahoo's 'slurp' spider has started requesting non-existent pages today.

What is correct, is that pages with the 'wcnn_nnn' part of the url do exist on my site, but the rest is nonsense.

Looks like the spider's database has got mixed up.

lj1070.inktomisearch.com - - [20/Jul/2004:08:34:32 +0100] "GET /music_link/wc01_012/columnist.htm HTTP/1.0" 404 294 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; [help.yahoo.com...]
lj1127.inktomisearch.com - - [20/Jul/2004:08:58:02 +0100] "GET /costumes/wc01_040.htm HTTP/1.0" 404 282 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; [help.yahoo.com...]
lj1075.inktomisearch.com - - [20/Jul/2004:10:43:03 +0100] "GET /name/wc01_074.htm HTTP/1.0" 404 278 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; [help.yahoo.com...]

DaveAtIFG

9:41 pm on Jul 20, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



There's another report here [webmasterworld.com] and some discussion in posts 13 and 14 here [webmasterworld.com].