Forum Moderators: open

Message Too Old, No Replies

spidered with slurp?

for penalized sites that are in Yahoo now

         

helenp

12:25 am on Apr 9, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Hi,
would like to ask you that had penalizings and now are in yahoos serps.
Though yahoo now have several spiders, I am a bit confused.
Until 22/3 slurp read my robots.txt several times per day, and then stopped to come back, as if Yahoo done something to avoid slurp read the robots file of penalized sites.

Since more than a week ago, my penalty was tooken away.
so everyday I check to see if slurp is back.

The 6/4 it came back only read robots.txt, and today 8/4 it been in twice for my robots.txt only.

To be indexed and in yahoos serp should I need to be spidered by slurp?

Maybe itīs to early and spider hasnīt been updated, but I think a bit strange that slurp hasnīt been around from 22/3 until 6/4.

cabos

2:38 am on Apr 9, 2004 (gmt 0)

10+ Year Member



It pisses me off that Yahoo would pick up photos from my site for people doing an image search but they wont show the sites content.

My images are good enough for Yahoo to display but not my content?

helenp

2:34 pm on Apr 9, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



>>>>cabos: It pisses me off that Yahoo would pick up photos from my site for people doing an image search but they wont show the sites content.
My images are good enough for Yahoo to display but not my content?
>>>>>>>

Actually, that wasnīt my question.
But that is a good point nobody spoked about.
If they only take your images but not the content, then they only eat the cream of the cake :)

Supposed If i disagreed about yahoo using my images for yahoo, AV and ATW, how would I put my robots.txt to exclude my images?
Which spider is indexing these images? obviusly not the same one that index contents?

If I didnīt wanīt google to index my images, that would be easy to fix, but what about Yahoo?

VigoZ

11:41 pm on Apr 13, 2004 (gmt 0)

10+ Year Member



i've the same problem.. slurp is spidering only my robots.txt page + index.html about twice a day.. but don't go deeply!

i don't know what to do..