Forum Moderators: bakedjake
I am very, very new at site creation and have only just uploaded my very first brand new site, so please excuse me if my questions seem a bit naive.
How can I know, from my webstats, which bot has read my site?
The obvious ones, like google or msn are written, but what are:
1. BLA
2. ia_archiver-web.archive.org
3. MetaTagRobot
As I said, my site is very, very new, so what other ones should I expect over the coming weeks?
And the million dollar question, should anybody know the answer, is how long after they appear in my stats should I expect to receive visitors from search engines?
This thread should probably be in Search Engine Spider Identification, but anyway
1. BLA is probably a e-mail harvester from what I've observed of its behaviour (someone correct me if they know better)
2. See [archive.org...] They keep archive copies of web pages for historical purposes.
3. Possibly [widexl.com...]
It is really hard to predict what other bots you will see as it varies greatly from site to site.
Also it is even harder to predict when you will get the first user finding you via a search engine, it could be days, it could be months.
Your site is new, and probably not getting whole heaps of traffic yet, so this won't take an enormous amount of time. It will be an education, and in the future when you use analyzer programs you'll have a much better idea of what you're seeing. I'd also suggest getting "Analog" to check logfiles, although it's a little complicated at first, if you have access to the raw files.
And the million dollar question, should anybody know the answer, is how long after they appear in my stats should I expect to receive visitors from search engines?
It depends ;-)
MSN might list you well fast (a couple of weeks), Y could take longer, and with G they might find you right away, and then you could encounter the dreaded "Sandbox".
Hope this helps you to understand more..
Heaps of regards
Dave Andrews