Welcome to WebmasterWorld Guest from

Forum Moderators: martinibuster

Message Too Old, No Replies

Those of you with Y! penalties....

Does slurp still spider your whole site?

6:36 pm on Apr 7, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 3, 2002
votes: 0

My site dropped from #1 to oblivion last week, even for its own content (searched in quotes) and for its domain. This may be due to the update that occurred or to the fact that I had just changed hosts and file formats (from traditional asp to .aspx).

BUT, slurp still spiders the site (most pages) everyday. I have heard that if you are banned/penalized it will just grab robots and index.


Is there hope for me?


2:09 pm on Apr 12, 2005 (gmt 0)

New User

10+ Year Member

joined:Sept 10, 2004
votes: 0

Yahoo probably still has the original .asp pages and is only now indexing the .aspx pages, so they probably don't rank as of yet.
What happens when people try to access the original .asp pages? 404? 301?

Hard to tell without more info...

Regarding a possible ban:

Check site:mydomain.com

If only your home page is there, you've been banned regardless of the behavior of Slurp.

I've seen Slurp grab other pages every once in a while. But they never make it into the index.