Welcome to WebmasterWorld Guest from 54.196.208.187

Forum Moderators: Ocean10000

Message Too Old, No Replies

YahooSeeker-Testing/v3.9

testing what ... I wonder?

     
8:12 pm on Jul 29, 2005 (gmt 0)

Senior Member

joined:May 21, 2002
posts:762
votes: 0


68.142.195.82 - - [29/Jul/2005:15:09:29 -0500] "GET /robots.txt HTTP/1.0" 200 4594 "-" "YahooSeeker-Testing/v3.9 (compatible; Mozilla 4.0; MSIE 5.5; [search.yahoo.com...]
7:48 am on Aug 19, 2005 (gmt 0)

New User

10+ Year Member

joined:Aug 29, 2004
posts:20
votes: 0


Sorry to bump this thread, but I also wonder.
8:52 am on Aug 19, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:Apr 12, 2004
posts:45
votes: 0


Me too.

It seems only to be interested in the newest pages created in my case. Still would be nice to know what this is for. It has been "testing" for several months now.

10:30 am on Aug 19, 2005 (gmt 0)

New User

10+ Year Member

joined:Aug 29, 2004
posts:20
votes: 0


>It seems only to be interested in the newest pages created in my case.
Thanks for the information. I'll study my logs to see If I notice anything else.
11:47 pm on Aug 24, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:Feb 3, 2005
posts:136
votes: 0


Just saw this for the first time today -- returned a 404 when looking for a robots.txt file that is there?
1:24 pm on Aug 25, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 22, 2001
posts:2450
votes: 0


The 404 error would have been generated by your web server, not the spider. Are you sure the robots.txt file is in the place where the spider thought it was? Was the spider asking for robots.txt in the / directory?