stinkfoot
msg:1532401 | 2:20 pm on Nov 22, 2005 (gmt 0) |
You may well be right and it is a bot problem, but I have noticed many many sites that have urls indexed on then. Be carful with the .asp?www.notmyurl.com stuff you may well end up getting banned as a scrapper. If it is trying to lift information from another server it may well find the other information and PUT it on your server.
|
Zaphod Beeblebrox
msg:1532402 | 8:26 am on Nov 23, 2005 (gmt 0) |
I see many other sites using the same principle. I think that as long as my page is not absolutely loaded with these links I'll be fine - I have less than 10 links in my portfolio. That last sentence I don't understand. Could you elaborate please?
|
stinkfoot
msg:1532403 | 5:19 pm on Nov 23, 2005 (gmt 0) |
>If it is trying to lift information from another server it may well find the other information and PUT it on your server. Ok I realy am not 100% about this but ... if the method you are using is innocent, it may just be the fact that many other use this method to grab pages on thier own server from others sites. I have found a number of .asp?myurl pages in search engines that are basically my content with my url in its url after a question mark, but ... the content has been cached and thus indexed as part of thier site. Enter duplicate content problems. To be honest I dont fully understand this issue thus will leave it there. If you or anyone knows how this?myurl thing works it may explain what I am trying to describe. What is the asp page doing with the?urlhere is it cacheing it locally?
|
Zaphod Beeblebrox
msg:1532404 | 9:31 am on Nov 24, 2005 (gmt 0) |
No, it's a method I use to detect outgoing clicks from my site. All it does is redirect to the page specified in the URL, but along the way it gets recorded in my logfiles. BTW - the bot in question has no reverse DNS specified, and since I emailed MSN about it it has been scanning my site around once every hour - more specifically it's been scanning those asp?URL= links only. I'm starting to suspect it's a new bot they're testing. The IP is 65.55.246.35.
|
|
