Forum Moderators: open

Message Too Old, No Replies

Yahoo crawling non-existent pages

         

webzilla

8:07 pm on Apr 27, 2004 (gmt 0)

10+ Year Member



Yahoo/Slurp has been trying to crawl pages on my site that do not exist, but which do exist on another totally unrelated site.

For instance it will try to crawl mydomain.com/thisdirectory/thispageABC.html, mydomain.com/thisdirectory/thispageDEF.html, etc.

Though these pages do not exist on my site, a search for thisdirectory+thispageABC and thispage+def, etc has located a site that these urls do belong to. The site in question is not related to mine in any way whatsoever; it is not mine, it does not link to me, I do not link to it, it is not on the same server, etc. but Yahoo keeps trying to access that site's pages on my site.

Any opinions?

deejay

11:46 pm on Apr 28, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm getting the same thing for hte last 24 hours or so - trying to crawl pages that don't and never have existed on my site. Most .html, but some asp and some php - neither of which I use.

Haven't gone as far as looking for a site that might actually own these pages, but the pagenames do look 'valid' - ie, they're sensible type names and directory names.

Damned annoying.

soapystar

5:59 am on Apr 29, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



sveral posts on this. Yahoo seemingly trying to see if sites on the server are related and have identical structure.