I've just finished working on a new site and so far it's not been submitted anywhere, no links nothing but I've noticed a few bots hitting it, any idea how?
Emma McCreary
8:40 am on Apr 24, 2003 (gmt 0)
are you running any toolbar apps like the google toolbar or the alexa toolbar? they can send data back, maybe they found your site that way.
Ove
8:45 am on Apr 24, 2003 (gmt 0)
Tigger,
I have seen that before and i think Alexa is one of the best crawler to find something that is not exicting :-)
And in this case i think if you got the toolbar as Emma said, have done it for you. It can be good and it can be bad hope it was good that the crawler find it.
/Ove
tigger
8:50 am on Apr 24, 2003 (gmt 0)
Thanks for coming back.
Like most I run the google toolbar, heck I see that green bar in my sleep :)
It's alexa I've seen hitting the site and I've never installed that toolbar.
Where else could it be finding the URL, don't get me wrong I'm not complaining just odd
Emma McCreary
9:06 am on Apr 24, 2003 (gmt 0)
maybe some sort of spyware app that got installed somehow? do you run a packet sniffer on your network connection?
Ove
9:07 am on Apr 24, 2003 (gmt 0)
I see this alot with new sites, and its Alexa that is the first crawler alltime, i dont know why, but sites i dont want to be crawled before i do, i password protect them and that is working fine for me.
Maybe Alexa is getting data from something like whois or another place with info about domain names, i dont know.
/Ove
Marketing Guy
9:15 am on Apr 24, 2003 (gmt 0)
Alexa use whois info for the "info" option on the toolbar, so that could be it.
Scott
tigger
9:31 am on Apr 24, 2003 (gmt 0)
>Alexa use whois info
thanks thats seems to be the answer, cheers for the help