Same here I launched mine 3 weeks ago and some links pointing to it have been found but googlebot is just not following them. I also had a friend email me quite concerned as he's new domain is still not indexed after 2 weeks.
I might be wrong but what i think is, either the new bot that seems to very slow is the cause or because of the recent/ongoing update Google are waiting to include new domains until it's more settled.
I think we need to give it another couple of weeks before we get really concerned.
Get somebody to link to you and you'll get noticed in a couple of days.
eeek, getting links is not the issue here. There seems to be a pattern of new domains not being indexed over the last 2 or 3 weeks for other reasons.
I'm seeing something similar - I launched a subdomain site about four weeks ago which has not been indexed.
I also purchased a new domain and launched a website on it two months ago. This has been indexed.
Now I know you'll spot that the subdomain hasn't been live for as long as the main domain, it's just there are no backlinks to the domain website nor have I even submitted it to google, yet the subdomain has been submitted and has a sitemap.
As Google is not crawling much at the moment then I guess it would be hard to find backlinks to new sites.
Googles mind is probably on other things at the moment - rather than listing new sites.
I agree with Dayo on this. Googlebot has basicly stopped crawling sites that have been added in the past 6-7 months. They also seem to be slowly dropping pages which were indexed... Something's going on.
ps- if you're concerned that a site added 2-3 weeks ago is not being indexed, you're in for a long hard battle. You have MANY months to go... good luck!
Is this something we can have GoogleGuy or the like provide more info (or has it been buried in a thread i missed?)?
This seems big enough they could let us know they are working on it and not keep us in such a black hole.
Come to think of it, can anyone remember when the last time Googleguy visited us? It's been sometime, if I'm not mistaken.
|Googlebot has basicly stopped crawling sites that have been added in the past 6-7 months. |
Well thats different to what I see, Google bot comes by my new one month old website every day, picks up the robot.txt takes three or four new pages and comes back the next day for more, They are getting indexed fine and showing in SERPs.
I launched 2 new sites in the past 3 weeks, one was immediately picked up by Google, the other not at all.
Both had backlinks from my other sites, biggest difference, I believe, is that the indexed site had a couple of backlinks from a monster site, Youtube.com. Some people had listed it in their profiles there, and then it also had backlinks from incoming clicks to YouTube from a video I had posted.
I have no proof this is the reason, but it's the only substantial difference I could find in terms of backlinks.
Getting new sites indexed quickly was always the exception rather than the rule.
This is what I have come to expect: The first month you will have your index page and any page that has a decent incoming link. The next month you will get many pages that are one click away from your best incoming links. The third month Google will index most of your pages.
I've had sites indexed faster, but there is no rhyme or reason to it. I don't start worrying till 3 months in.
Thanks for the responses.
I don't think in-linking is the case - Like I said, I have a number of other sites that were indexed within 48-72 hours, and I was even #1 in my niche only one-week after launching. Perhaps it is more the exception than the rule.
How long does it take to get indexed by the other search engines? Even at this point, it's not being indexed by any of the big three. Is it possible that a previous site at this domain is somehow on a black-list? Or should I just shuttup and stop worrying until 6 mos or so down the line?
MSN pickes up pages pretty quickly - but wont deep crawl a big site.
Yahoo can take a while - 2-3 months for a single page - 4+ months for the site - if you are lucky.
--- Google bot comes by my new one month old website every day, picks up the robot.txt takes three or four new pages and comes back the next day for more
I wasn't really commenting on 2 or 3 pages per day... I've been seeing a change from 1-2 thousand pages a day dropping to 10-20 pages per day.
I register a domain about 3 months ago, put a site of about 20 pages, updated them multiple times. By now all the pages are indexed by MSN, half by Yahoo, but nothing by Google. Googlebot scanned all the pages many times. I also submitted sitemap at the very beginning. Google actually sucks.
I started a site about three months ago. I had blocked all robots while I worked on developing the site. Two weeks ago I removed the robots.txt and since then Google has crawled over 400 pages and so far about a dozen are listed.
I find Googlebot behavior on my sites highly stable and predictable -- except when a new pattern is being established. That is certainly the case right now.
I wouldn't spend much time focusing on Googlebot issues at the moment until things settle down.