Forum Moderators: open

Message Too Old, No Replies

Updated Ask UA

Has anyone else seen this?

         

GaryK

3:19 pm on Jan 25, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)

Came from a known Ask IP Address.

Mokita

11:07 pm on Jan 25, 2007 (gmt 0)

10+ Year Member



Yes:

65.214.45.100 - - [25/Jan/2007:00:25:39 -0500] "GET /robots.txt HTTP/1.0" 200 2174 "-" "Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml)"

Ocean10000

2:30 am on Jan 26, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Yes

Mozilla/5.0 (compatible; Ask Jeeves/Teoma; [about.ask.com...]

65.214.45.100
GET
/robots.txt
1/25/2007 5:21:00 AM

incrediBILL

5:27 am on Jan 26, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



They started crawling from a block I've never seen them crawl before as well:

ASK JEEVES INC Q0321-65-119-214-0 (NET-65-119-214-0-1)
65.119.214.0 - 65.119.214.255

Ocean10000

6:04 am on Jan 26, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Bill, I first seen Ask.com crawl from that IP range back in September of 2006. They just use that range sparingly,

Ocean

[edited by: Ocean10000 at 6:05 am (utc) on Jan. 26, 2007]

GaryK

8:32 am on Jan 26, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks everyone. :)

wilderness

6:07 am on Feb 3, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



206.80.1.253 - - [02/Feb/2007:18:20:50 -0800] "GET /robots.txt HTTP/1.1" 200 4444 "-" "-"
206.80.1.253 - - [02/Feb/2007:18:20:50 -0800] "GET /MyFolder/MyPage HTTP/1.1" 403 - "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9a1) Gecko/20070118 Minefield/3.0a1"

GaryK

8:33 am on Feb 3, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I was confused by your post Don until I did a WHOIS on those addresses and found they belong to Ask. Looks like Ask is up to sneaky tactics just like Y! and MSN. Thanks. ;)

wilderness

2:04 pm on Feb 3, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Aye Gary.

And all we need is another productive crawler from Ask ;)
(If that's not an oxymoron, there never was one.)

GaryK

8:09 pm on Feb 3, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I think I'm gonna completely ban them like I've done with Y!. I get no traffic from them at all; none.

photoace

7:37 pm on Feb 5, 2007 (gmt 0)

10+ Year Member



I have ban them via .htaccess months ago. Since they refuse to honor robots.txt.