Page is a not externally linkable
- Search Engines
-- Ask - Teoma
---- entire site "mis"-crawled with appended % 20 codes.


Drreggae - 11:20 am on Jan 4, 2008 (gmt 0)


Thanks Vivek!
I just came back here to post that indeed that crawler now
started to act normal again since, a small week or so.
Now we hope to see the same traffic as before back again;-)
(sure part is the holidays and end of Q4..:-()

regards!

Btw, gonna ask this in another subforum, but.. is that crawler: 78.137.163.133 coming from digiweb.ie with
"Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9a1) Gecko/20070308 Minefield/3.0a1"

by any chance a crawler from ask.com? I wonder, cause some
ask crawlers indeed come from .ie if I am correct, and always
use Minefield..

This 78.137.163.133 is all over the web in visible access logs
etc, ( ip-78-137-163-133.dedi.digiweb.ie ).
Since it does no identify itself, I now block it via .htaccess
but surely would be not doing that if I knew if was from
ask.com..

[edited by: Drreggae at 11:27 am (utc) on Jan. 4, 2008]


Thread source:: http://www.webmasterworld.com/ask_jeeves_teoma/3536339.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com