Welcome to WebmasterWorld Guest from

Forum Moderators: martinibuster

Message Too Old, No Replies

Why is Y! indexing non-existing pages?

They were removed years ago...



8:47 am on May 31, 2005 (gmt 0)

10+ Year Member

I have a site which is more than 5 years old.
It's been in Yahoo! directory and Dmoz for more than 4 years. It performs excellently in Google and MSN
Last April Y! found my site to be banned, and kicked me out of their index. Only my homepage and robots.txt were indexed by Slurp since then. I tried to email them a few times, but I got tired of their canned useless responses.

I wouldn't care too much about it, I receive enough traffic from G (though I obviously would need Y! traffic as well), but a few days ago I noticed an increased activity of Slurp. I looked at my logs, and saw that apart from a few existing pages, many non-existing pages were crawled. These pages were removed from the site at least 3 years ago!
Why the hell Y! wants to index these pages? Or is it only the sign of ban?
(As I remember well, the same thing happened about six months ago)

BTW after these two busy days of Slurp, everything settled back to the good old way: Slurp indexes homepage and robots.txt, or simply nothing..

Any input will be appreciated.


3:50 pm on Jun 2, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I'm mystified too by Slurp. Every day it grabs hundreds if not thousands of pages a day of ours that no longer exist and are 301 redirected to another page.

Import Export

12:09 am on Jun 4, 2005 (gmt 0)

10+ Year Member

I can confirm the activity over here... Pages from pre millenium..


2:38 am on Jun 7, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Was that the first millennium or the second?

Featured Threads

Hot Threads This Week

Hot Threads This Month