Forum Moderators: open

Message Too Old, No Replies

Yahoo morgue bot

user agent and/or IP for Yahoo's dead link checker?

         

Drew_Black

11:44 pm on Jul 21, 2003 (gmt 0)

10+ Year Member



Does anyone know the best way to detect Yahoo's morgue bot? I keep getting removed from the index and their support group says it's because my site is down. I find this hard to believe because the stats from my remote monitoring service say we're up more than 99% of the time.

I figure it's got to be something to do with their bot. I'd like to detect it and log any accesses but I haven't been able to identify it yet.

Any help is greatly appreciated.

marcs

11:53 pm on Jul 22, 2003 (gmt 0)

10+ Year Member



Found this one in logs, it is likely the morgue bot you are trying to identify :

morgue2.corp.yahoo.com - - [02/Jul/2003:16:04:11 -0700] "GET / HTTP/1.0" 200 4418 "-" "Mozilla/4.05 [en]"

Drew_Black

12:05 am on Jul 23, 2003 (gmt 0)

10+ Year Member



Thank you very much. That's what I needed.