Verizon Directory Sales - East Co.

[wilderness]

151.138.18.xx - - [16/Nov/2004:05:05:21 -0800] "GET /Myfolder/mypage.html
HTTP/1.1" 200 24582 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0;
AT&T CSM7.0; .NET CLR 1.1.4322; .NET CLR 1.0.3705)"

Unable to find any mention of a bot in a google.
Four pages at 13-15 minute intervals.
No robots. No images.

Be nice to have an insight into their itinerary. Unable to imagine Verizon publishing web links or equestrian articles in their telephone directories ;)

[edited by: volatilegx at 2:00 am (utc) on Nov. 17, 2004]
[edit reason] obfuscated IP [/edit]

[volatilegx]

Couldn't it be somebody with images disabled?

[wilderness]

It's not likely Dan.
There is no travel pattern in the page grabs. At least not as they "are" being grabbed.
The visitor has since returned to 403's. Even these newer visits are not in a consistent pattern with the previous pages visited.

Did you do an ARIN on the IP?
I don't believe it to be the hosting portion of the IP rather their own sales staff (at least as interpeted from the ARIN results and the google attempt.)

[volatilegx]

> 13-15 minute intervals

I thought that was the really interesting part.

[wilderness]

I thought that was the really interesting part.

There have been stranger instances of frequency.
I don't reall the bot or IP range, however had one that was only grabbing 2-3 pages a day.

[fiestagirl]

I've seen about 10,000 requests from this one this month.
IP: 151.138.18.xx
UA: Mozilla/4.0_(compatible;_MSIE_6.0;_Windows_NT_5.0;_AT&T_CSM7.0;_.NET_CLR_1.1.4322;_.NET_CLR_1.0.3705)
UA: FAST_Enterprise_Crawler_6_used_by_FAST_Search_(Verizon)_([e-mail])
UA: Verizon_Superpages_Web_Crawler

Only this one is requesting robots.txt: Verizon_Superpages_Web_Crawler

[wilderness]

fiesta,
Ya been so quiet ;)

I have Fast in my robots.
It appears to be a circumvention of sorts.