Google Only Crawls the Index Page

[benindia]

Hello ,

I have submitted my site 2 months back, but still Google is just crawling only my index page, is it not indexing all the other HTML pages.

I have exchanged links with many, used Header tags, Meta Tags. BUT STILL....
Is there some problem with the code of my site since the site has both HTML and asp pages.

Could that be the reason that Googlebot is not spidering my complete website or some other reason.

Any kind of feedback would really be helpful.

Waiting for reply

Thanx
-Ben

[edited by: trillianjedi at 10:36 am (utc) on Mar. 21, 2005]
[edit reason] No URL drops please, as per TOS [/edit]

[specter]

Hi and welcome to the Webmasterworld,

Your problem could depend on your internal links:
Try to link the "Home" with the other pages by means of textual links,as some spiders have difficult to recognize non-textual links such as pictures ,animations,etc...

BTW don't display your real url in the posts or any personal data;is not allowed in this forum...

Regards

[taps]

Maybe you are using sessions. Normally the session information is stored in cookies. However, if a browser does not accept cookies (like Googlebot), the session ID is stored in an URL-Parameter like

www.widged.xy/mypage.php?SID=3e23892332e3e89

Googlebot does not like those session IDs and does not follow the links.

The best way to avoid this is not to use sessions. The second best way is to check for "Googlebot" as agent description and to avoid using sessions for this agent.

[top5jamaica]

i've seen google take a while to crawl much past the homepage of some new sites. could be sandbox related anyone thinks?

[jschmitz]

internal links were my problem - added textbased internal links, plus, adding robots.txt file seem to help, and a 'sitemap' page.

judy

[Jakpot]

Google has had a general problem in indexing pages
for quite some time but they are not talking.
Thousands of pages are being shown as url only.
Eventually they may fix it but don't count on it
anytime soon.

[specter]

Google has had a general problem in indexing pages
for quite some time but they are not talking.

Highly improbable.
Displayings only url is the result of web site design errors.

I never came across this problem managing my web sites.

Moreover the submission of Benindia is quite recent to support your explaination.

[Reid]

just make sure you have a good ol HTML sitemap.
a robots.txt file
no sessions for googlebot.
Also for a new submission google will typically come and just look at the index page and go away for a while before coming back to crawl the site.
If it gets an updated index page every time it comes you may be causing it to loop through that first run again. So fix the index to what you like and link it to a sitemap and try leaving it alone for a bit.

[bears5122]

I think you just need to be patient. Get a good one way link coming in to your site.

For the most part, your index page is probably not considered very strong by Google, thus they haven't taken the time to deep crawl your site yet. A few links should help that. Otherwise, just be patient, they'll get you soon enough.

[benindia]

Hi to All,

I have read your valuable inputs regarding my website.
I would really really be obliged if you could help me, rank my website properly in Google.

I am suffering heavily.
The site is coming with exotic india crafts on the 160 Page.
No where with Sculptures, Textiles, Silver Sterling Jewelry, Glass Handicrafts Stain Glass Paintings, Brass Artifacts, brass bronze handicrafts and many many more.

It is not coming with any of my products.

I hope you understand my problem & help me getting my way through Google.

Thanx
Ben