Help needed regarding getting an initial listing

[david burton]

Hi,

I've designed a site and uploaded it about 2 months ago. I've also submitted it to many directories and search engines.

Googlebot keeps visiting, looking for robots.txt and then leaving. I have a blank robots.txt file (it didn't exist initially). Google has also (once) visited the page I submitted, but has not crawled any deeper. Slurp does the same. The only crawler which has gone further is jeeves.

Is there some trick I am missing? My navigation is in table format, but should this be a problem? All I would like is for google to look further than robots.txt!

Any help is greatly appreciated.

Dave

[JonR28]

Google doesn't seem to be going so deep on low PR sites very quickly theese days. Been having a lot of trouble with my new sites too. Just keep working on inbound links and also might want to add the code to Robots.txt that google suggests in its FAQ.

[david burton]

Cheers for the info mate - I have a plan to get inbound links through another site of a friend. This should work hopefully!

Nice to know I am not alone!

Dave

[somerset]

Get your site listed in some of the many free and paid directories.

There are some with PR5 on the links pages. That should at least start your ball rolling.

[MaxM]

I had the same problem. That lasted until the site was added to two sections in Yahoo directory. These Yahoo directory pages have PR of 6 and 7. Now it seems Googlebot can't get enough. Interestingly I haven't seen any change with other spiders including Slurp.

[webdev]

Keep getting on topic links and also try to get links to your subpages that are more niche content.. such as links to the red widget page and the blue widget page etc..