Forum Moderators: bakedjake

Message Too Old, No Replies

On AOL - how did this happen?

Roughly 98 out of first 100 spots to one site...

         

Robert Charlton

6:39 am on May 2, 2001 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Run this search [search.aol.com] on aol, and keep going to next page of results until you get bored. I'm trying to figure out where this comes from... I don't see it on either Inktomi or ODP.

And what's worse... when you try any of the links, the products aren't there. It's not quite like a hundred 404 pages belonging to the same site, but the effect is the same.

4eyes

8:51 am on May 2, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Could it be:
...a message from above telling us to stop surfing and get out more :-)

...or someone hit the doorway page generator button a few too many times then got scared and removed them all.

...or someone at AOL has shares in their company

vis

9:10 am on May 2, 2001 (gmt 0)

10+ Year Member



Well, its in the Open Directory section (i.e. web sites) so it must just be an AOL problem. Looks like the poor AOL spider got stuck in a 'spider-trap.'

Incidentally the company has managed to blag 5 ODP listings, one of which is a dynamic page which could have snared the spider.

The 'web-pages' section is from Inktomi and the Inktomi results are more relevant and less full of spam (and I never though I'd write _that_ sentence.)