Forum Moderators: open

Message Too Old, No Replies

Jeeves

         

wilderness

4:07 pm on Feb 12, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Might anybody be aware if this is a New UA for Ask Jeeves.
The past few days the rename has been catching one of my UA filters.

65.214.44.195 - - [12/Feb/2006:06:26:56 -0800] "GET /robots.txt HTTP/1.0" 403 - "-" "Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html)"

Don't these bots explore the internet before creating new UA names? (i.e. Lycos "Spider")

thetrasher

6:36 pm on Feb 13, 2006 (gmt 0)

10+ Year Member



Old UA, it's Ask/Teoma. Why did you post in "Search Engine Spider Identification"?

wilderness

9:19 pm on Feb 13, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Why did you post in "Search Engine Spider Identification"?

It took me more than a day to realize my mistake ;)
After pouring over my htaccess looking for a syntax error.

Finally caught a line that I had missed initially.

On Feb 1st I added the UA crawl for the following visit:

71.39.139.xx - - [01/Feb/2006:16:56:23 -0800] "HEAD / HTTP/1.1" 200 0 "-"
"test crawler"

It's now been modified.