Google wont spider my site

Google only spiders the index page and then stops

[designhaus]

Hi all,

I have a small problem in that I launched a new site 4 weeks ago. Google quickly spidered the homepage and didnt look any further. When i make changes the the index page it again re-spiders it but just wont respider any other pages.

I have designed and marketed heaps of websites in the past and have never had this problem. I just cant understand why? What i wanted to know was if anyone else had experienced similar problems in the past or is this just a climatic problem in light of the Florida update?

Any suggestions will be hugely appreciated!

[takagi]

Short checklist:
- enough inbound links from other sides (on pages already indexed by Google; preferably pages that often show fresh tags and have a reasonable PageRank)
- no session IDs (or paramaters/values that looks like that) or multiple parameters for dynamic pages
- links in normal HTML (no JavaScript, Flash, etc)
- good robots.txt
- no problems with 'noindex' and/or 'nofollow'
- no penalty for previous owner of domain name
- no duplicate content/redirect/etc.

BTW, 4 weeks is not that long. Give it time. Not so long ago you needed up to 2 months to get the home page indexed in Google.

[designhaus]

thank you takagi
I really appreciate those points.

My site passes on all apart from maybe not enough inbound links. I did have one question about the robots.txt file. The only text inside the file is

User-agent: Mediapartners-Google*
Disallow: /admin

Is there anything else I should be including?

[mcavill]

There's a list of bots that you might want to consider banning here: [webmasterworld.com...]

As far as I understand you don't need to ban the Google Media Bot as it should only look at pages with Adsense on them rather than follow links to your admin pages.

[HighPR]

I think that a comprehensive site map linked from the index page would help as well.

[designhaus]

thanks everyone .. all i needed was some patience. google finally spidered it!