Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- AVG Stops Real-Time Scanning


Samizdata - 4:47 pm on Jul 8, 2008 (gmt 0)


Only weird thing I noticed was searching on yahoo

When AVG does its "first run" you get sent to an "Installation successful!" webpage which states:

"Users of Yahoo! search will notice that only dangerous, suspicious or unknown links will be marked. All unmarked links have been checked and found to be safe."

I doubt that anyone needs further comment from me on that one.

One point that wasn't mentioned about the previous LinkScanner incarnation is that due to Yahoo's idiotic habit of stripping the trailing slash from directory links the number of LinkScanner hits in the logs were often doubled due to the 301 it caused.

Fortunately those days appear to be gone, but continued vigilance would seem sensible.

I'm thinking that those who pushed LinkScanner into AVG 8 had very little idea of what they were getting into

That is my candidate for understatement of the year.

...


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3691977.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com