Forum Moderators: Robert Charlton & goodroi
Found something today that may interest you all, forgive me / flame me if its old news :)
One of the sites I look after has a lot of registered only links and we 'cloak' these links to freely accessible pages for certain UA strings...
I found some timestamped content in the google (supplementary results) cache at 72.14.207.104 containing loads of links to 401'ing / registration required pages. Damn google, why was the UA cloaking not working?
I checked server logs and found request with same timestamp as page in cache from 66.249.72.164 with a UA of "Mediapartners-Google/2.1"
No requests from Googlebot, just the adsense spider.
So the Adsense spider now supplies the google supplementary index. Has anyone else seen this?
