Forum Moderators: open

Message Too Old, No Replies

New site getting crawled already

         

tigger

8:04 am on Apr 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've just finished working on a new site and so far it's not been submitted anywhere, no links nothing but I've noticed a few bots hitting it, any idea how?

Emma McCreary

8:40 am on Apr 24, 2003 (gmt 0)

10+ Year Member



are you running any toolbar apps like the google toolbar or the alexa toolbar? they can send data back, maybe they found your site that way.

Ove

8:45 am on Apr 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Tigger,

I have seen that before and i think Alexa is one of the best crawler to find something that is not exicting :-)

And in this case i think if you got the toolbar as Emma said, have done it for you.
It can be good and it can be bad hope it was good that the crawler find it.

/Ove

tigger

8:50 am on Apr 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Thanks for coming back.

Like most I run the google toolbar, heck I see that green bar in my sleep :)

It's alexa I've seen hitting the site and I've never installed that toolbar.

Where else could it be finding the URL, don't get me wrong I'm not complaining just odd

Emma McCreary

9:06 am on Apr 24, 2003 (gmt 0)

10+ Year Member



maybe some sort of spyware app that got installed somehow? do you run a packet sniffer on your network connection?

Ove

9:07 am on Apr 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I see this alot with new sites, and its Alexa that is the first crawler alltime, i dont know why, but sites i dont want to be crawled before i do, i password protect them and that is working fine for me.

Maybe Alexa is getting data from something like whois or another place with info about domain names, i dont know.

/Ove

Marketing Guy

9:15 am on Apr 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Alexa use whois info for the "info" option on the toolbar, so that could be it.

Scott

tigger

9:31 am on Apr 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>Alexa use whois info

thanks thats seems to be the answer, cheers for the help