Forum Moderators: open
but it is a huge block and maybe rented out to companies?
this is the UA
"Mozilla/4.0 (compatible; MSIE 7.0; AOL 9.0; Windows NT 5.1; .NET CLR 1.0.3705; .NET CLR 1.1.4322; Media Center PC 4.0)"
and the addresses vary during each round of hits but are within a few seconds of each other and same UA.
Is this AOL search engine? or something else?
they don't list a bot name, just 'AOL 9' as you can see.
I don't want to block AOL (which now shows as 'enhanced by google') as they list search terms from my site which shows.
[edited by: incrediBILL at 1:22 am (utc) on July 10, 2008]
[edit reason] formatting [/edit]
For some reason I thought webmasterworld was blocking indexing
There use to be some custom html coding for the various bots on an active Webmaster World web page.
I utilize two custom searches, one specifically for this forum, which shows primarily older threads, and another for the entire Webmmaster World.