Forum Moderators: bakedjake

Message Too Old, No Replies

should i ban alexa from crawling my site

i only hear bad things about alexa should i ban?

         

onedumbear

4:16 pm on Jul 19, 2003 (gmt 0)

10+ Year Member



I noteiced i had a visit from alexa on June 24, 2003. I've looked into the alexa crawler and seen alot of bad things about it. Can someone tell me if i should ban the alexa bot from my site and why. I do not get any hits from them.
I would also like to know if anyone can tell me how long it currently takes for Inktomi to add you to their search results once slurp has found you?
......Also some of you may find it interesting to know that...
Slurp has been at my site every day since July 8 to the present, july 18. I have not paid for inclusion to any search engines, including Inktomi and my site has only been UP for a month and a half. I did submit once through the free sumbit process.
thanks to all for any help or suggestions,
onedumbear.

jrobbio

4:42 pm on Jul 19, 2003 (gmt 0)

10+ Year Member



Personally, I do block Alexa from my site although I probably have different motives to why you should or should not block it.
If you have a unique design or content, then it can be a good thing to have the Alexa bot checking it out as the pages are saved at archive.org at a later date. If there is a dispute over something, then it can be used as proof of ownership.

If you have the right links going to your site, you'll find Inktomi crawling over your pages. Check out positiontech to see pure inktomi results.

Rob