Forum Moderators: phranque

Message Too Old, No Replies

Is it an IE6 option?

IE6 or a spider of some sorts?

         

davelms

10:18 pm on Jul 21, 2003 (gmt 0)

10+ Year Member



Ok, don't know whether to post this on the search engine identification page but it could just be IE6 options. A hit came to my site from 212.159.95.181 which is probably a individual via a UK ISP. Standard IE6 access which came to the index page and took images, etc as usual. Then... after a pause of 10 seconds or so after taking the index page, and over the next 10-15 minutes, requested pages only (no images) at the rate of 4/5 per second with only an occasional pause. The UA changed at this point, but same IP address. Several thousand pages later and my whole site downloaded.

Now my question is, is this normal behaviour and perhaps a function of IE6. I haven't seem what website access logs look like when using the download for offline reading within IE so perhaps the user simply hit that? Or is this something more sinister?

Any help, and I do appologise for maybe being a bit naive here. Ta.

ncw164x

10:21 pm on Jul 21, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Is there any reference to DigExt

ikbenhet1

10:22 pm on Jul 21, 2003 (gmt 0)

10+ Year Member



When you click "Add To Favorites" there is an option "make availible offline" .
There is a button "Custimize" there you can select how many levels deep you want the page offline.

when you select 2 or 3 levels and click ok, it starts pulling pages pretty hard.

Could this be it? you can try it and see if your logs show similar enties when you perform this action. (try it on your own site, not ww)

davelms

6:23 pm on Jul 25, 2003 (gmt 0)

10+ Year Member



Ok Thanks. I tried it myself via IE6 and got similar results although the UA was not affected in the same way as my logs showed for this user. My general opinion is that this was legitimate activity, albeit annoying for me. IE offline content function crawls sites way too fast imho. Thanks again.

vincevincevince

6:25 pm on Jul 25, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



...what did the UA change to?