Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- U of Cal


keyplyr - 3:49 am on Feb 4, 2013 (gmt 0)


RE: free ride

And I don't either. I block all CS dept bots. I was just sayin' that some sites (like mine) have a measurable human user base coming from univ. I'm a univ professor and my main site used to be on the Univ of Cal servers for a few years before I changed the model to for-profit and moved it to a hosting company. I'm still indexed by the combined univ library system and many classes use my material in their curriculum w/ incoming links for citation.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4541980.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com