Is this robots.txt blocking anybody

[nalavanje]

Hi this is how my robots.txt looks like:

User-agent: *
Disallow:

Googlebot is not getting past my homepage. I'm just making sure that my robots.txt is not the problem.
Could anybody verify this for me please?

Thank you

[RobbieD]

Looks like you are blocking everyone with that robots.txt. Do you really want to do this?

[MarkHutch]

I'm not expert on this, but I believe your robots.txt file is set to allow all robots complete access to your site.

Allow all is:

User-agent: *
Disallow:

Disallow all is:

User-agent: *
Disallow: /

[ncw164x]

MarkHutch is right you robots.txt file is not blocking any bots so your problem must be elsewhere

This indicates that nothing is disallowed and the spider can follow all links
User-agent: *
Disallow:

To allow a single robot complete access and exclude all others
User-agent: Googlebot/1.0
Disallow:
User-agent: *
Disallow: /

This would prevent your entire web site from being indexed
User-agent: *
Disallow: /

ncw164x

[nalavanje]

Thank you all.

Is it normal for Googlebot to crawl just the home page for a week or two (my site was launched on January 15th 2004) and than do deep crawl later. Or this is something unusual?
For the last two weeks Googlebot visits my home page one or twice a day and it crawls only robots.txt and home page.

nalavanje

[ncw164x]

No it's not unusual for googlebot to do this especially if the site is new, it will visit often but only request the robots.txt file or the index page of your site.

I have noticed this on the latest sites which I have put online that it has taken a few weeks to do a deep crawl

Just got to hang on in there till it happens

ncw164x

[moltar]

Get some links to your site and Google will crawl your whole site instantly!

[nalavanje]

I did get some links. Now I have around 18 links pointing to my home page and I also have 2 deep links I obtained in last 3 days. I guess I just need keep waiting.