Google bot stops in index and robots.txt

Why? New content is not crawled...

[silverbytes]

I see google bot crawling index.html and robots.txt only...
I'm very worried since I've uploaded new content 2 weeks ago but it's unseen...

What happens?

[EliteWeb]

The time Googlebot spends on your site and the amount of content it takes along with the frequency of the visits depends on a few things.

How new is your site?
How many differnt sites link to yours?
Is your site flash enhanced at all?

By having more links to your site you will see the robot at your site more. If your site is fairly new it may take some time to get the bot a frequent flyer :)

[PhraSEOlogy]

I have just put up a new UK site. Put a link to it and left it for googlebot to find. It found the link to it and crawled all of the content within a week. My client's site in the US was updated around the same time and I am still waiting for google to crawl for the new pages.

Perhaps site location may be a factor - just an observation.

[silverbytes]

My site is 8 months old, is listed by google since 3 months. Has pr 4 some 20 backward links some 7 recognized by google.
But that's no reason at all for crawling just 2 files, in fact index is crawled twice a day.

Does some one knows really?

[martyt]

A few of the more obvious things to consider - presume you've already done all this:

* Have you validated the format of your robots.txt file?
[searchengineworld.com...]

* Have you validated your index.html page? I suppose if it was really non-standard HTML, the spider might give up and not follow links.
[searchengineworld.com...]

* Are the links on your page actually in <A HREF= ...> tags, or do you use some fancy javascript for the links?

* Are the backlinks to your site all pointing at the same page (your index.html), or do they point to different pages?

[silverbytes]

the backward links point to www.mysite.com only.
yes are href no javascripts
html is not valid but with same index page I got listed and crawled other internal pages in same conditions..

heres what validator of w3c says: (note that the one provided in link is not working)...

This page is not Valid HTML 4.01 Transitional!
Below are the results of attempting to parse this document with an SGML parser. height="100%"

And if someone can explain how to replace my height 100% table for w3c compilant code I will be grateful too...

(I really don't know why is bad)