Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: bakedjake
ODP Results Example: cloaking [aolsearch.aol.com]
In the past AOL has used Inktomi. However, there is a major new twist to the scheme - aol doing it's own spidering.
spider identification [aolsearch.aol.com]. It's probably a time sensitive search, but scroll down to the listing for WebmasterWorld and notice the ip address in the description:
Which resolves to cache-rh07.proxy.aol.com. That's AOL doing their own spidering, indexing, and listing - eg: it aint Inktomi no more.
This change has taken place pretty quietly. For the potential traffic that is there, we should know a great deal more than we do now.
If you run "nocache" headers, will AOL still spider and list you? Appears so.
Where does Inktomi come into all this now? How many Ink listings are there still in there? (I don't think so - I can't find any recent Ink optimized cloaked pages showing up on AOL).
I think I'm still seeing some Inktomi listings in there, but no doubt at least some of those listings are coming from a cache spider. They are mixing in ODP descriptions and titles also on cache spidered pages messing up some test pages that would show this better.
Going to look at this some more tomorrow,
this could be very interesting...