Forum Moderators: open

Message Too Old, No Replies

AOL Spidering

         

JohnNovaNYC

5:15 pm on Feb 16, 2001 (gmt 0)



Does anyone know how do you know if AOL has spidered you? I got 70-80 hits all about 15-30 seconds apart yesterday so I wonder if they finally spidered me since I got into DMOz on the 7th or even worst maybe some competitor was sucking in my site...Maybe I am being paranoid. LOL :)

tedster

10:46 pm on Feb 16, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



See this thread for some ideas about what you are seeing:

[webmasterworld.com...]

JohnNovaNYC

10:58 pm on Feb 16, 2001 (gmt 0)



From what I gather you will never really know if they spider you. I guess I will have to keep checking. oh boooo. I hate aol, but considering that they 26+ million members we all have to deal with them.

Laisha

2:40 am on Feb 18, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>I hate aol, but considering that they 26+ million members we all have to deal with them.

Actually, the estimates are that there are between 2 and 4 times 26 million sets of eyeballs.

Every paid account has the capacity to have 7 screen names, and the last estimate I read was that the average account had 3.25 different people on them.