Speedy Bot

Ask/Teoma first into new site

[hamster77]

Just put up a new site and I thought I'd have a look at which bots came in first.

First in: Ask/Teoma - 2 hours after I put the site up and had a good crawl around the full site.
Second: MSN - about 4 hours
Third: Google - about 12 hours, looked for robots.txt then left

(Also a few spambots have been around)

No sign of Yahoo yet.

Anyway, I thought this was interesting to see that Ask came by so fast, since Ask is listing and ranking my sites very fast and very well at the moment. I don't have PFI on any sites, but Ask is definitely my best friend at the moment.

Anyone else getting visited by Ask/Teoma before anything else?

[mars9820]

Hamster what kind of inbound links do you have on this new page?

It might be that your links are all spidered daily by the bots and therefore you will get visits quite quickly.

I know about people that run businesses and ask a company to create a website and after that they pay zero attention towards link development.

If you watch their statistics you won't see many robots even after 1 or 2 year (at least they are not listed in any of the search engines so I wonder if the robots even know about their page). :)

[hamster77]

It's a new site, not just a new page. And is approx 20 hours old at the time of posting.

The new site has only one inbound link at the moment (so far as I know) and that's from a directory page on my main site which is constantly and heavily spidered.

I was interested to see which spiders came in first and how much of the site they crawled. Ask has been doing really well all round for me at the moment, but I was still surprised to see a full crawl from the bot that quickly.

I'm going to keep an eye on this one and see when it gets indexed and ranked in various SEs.

[snort]

Three of my new sites also got spidered the same day they went online. Unfortunately it took over two months before the first started showing up in the results. I'm still waiting for the other two.

[sidyadav]

Wow. One of my sites has been around since like 4 or 5 months, it ranks well on Google and Yahoo, receives a decent amount of traffic, but Ask/Teoma is the only one search engine to not have fetched it yet!

And as there's no URL submissions page, I can't ping them to.

There is a way of course, PFI, but I'd rather spend money on advertising :)

Sid

[caine]

Good news.

hamster77,

let us know how long it takes from today for the new site to start displaying in the SERPs at AJ.

[CompressedAir]

AJ was the first one to come to my new site as well. But it only looked for robots.txt and the homepage. No full crawl for me :/