Forum Moderators: open

Message Too Old, No Replies

Yahoo!'s Hotjobs bot

         

volatilegx

2:34 pm on Jul 7, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Continuing from [webmasterworld.com...]

Yahoo! announced on their blog today that they are now using their index to "organically discover job listings on the web".

The user agent doing the crawling for this appears to be different from the standard Slurp:

"YahooSeeker/CafeKelsa-dev (compatible; Konqueror/3.2; FreeBSD ;cafekelsa-dev-webmaster@yahoo-inc.com )

idoc

5:46 pm on Jul 11, 2005 (gmt 0)

10+ Year Member



Yep, I was just tracing the i.p. for this one. It took the index and the contact etc. 5 pages total.

64.157.138.108 - - [11/Jul/2005:03:19:03 -0400] "GET /index.html HTTP/1.0" 200 14187 "-" "YahooSeeker/CafeKelsa (compatible; Konqueror/3.2; FreeBSD ;yahoo dash slurp dash h dash webmaster at yahoo dash inc dot com ) (KHTML, like Gecko)"

On traceroute it resolves here: lsa08.hj.ny1.yahoo.com.