Forum Moderators: open

Message Too Old, No Replies

Disney.com Spidering

lwp-trivial/1.28

         

Froggyman

8:34 pm on Jun 12, 2001 (gmt 0)



It's laughable but I have been getting a lot of hits from Disney lately. So much so that they tried to spider my site using lwp-trivial/1.28. Currently, I have banned this agent (for different reasons) but I'm wondering if there could be a good traffic return on this spider activity. Why would Disney spider my site and for what? Some search engine I cannot think of?

skirril

1:09 pm on Jun 25, 2001 (gmt 0)

10+ Year Member



Isn't the former InfoSeek (now Go) operated by Disney? - could they be trying to relaunch it?

InfoSeek Germany uses a different agent though, I have no clue why they'd use something as std. as lwp/trivial..

Also, with the AOL/TimeWarner fusion, they could be looking to get a name in the net-economy, possibly by launching their own portal (other than go), for which they need content.