homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Google Only Crawls the Index Page

 5:03 am on Mar 21, 2005 (gmt 0)

Hello ,

I have submitted my site 2 months back, but still Google is just crawling only my index page, is it not indexing all the other HTML pages.

I have exchanged links with many, used Header tags, Meta Tags. BUT STILL....
Is there some problem with the code of my site since the site has both HTML and asp pages.

Could that be the reason that Googlebot is not spidering my complete website or some other reason.

Any kind of feedback would really be helpful.

Waiting for reply


[edited by: trillianjedi at 10:36 am (utc) on Mar. 21, 2005]
[edit reason] No URL drops please, as per TOS [/edit]



 7:01 am on Mar 21, 2005 (gmt 0)

Hi and welcome to the Webmasterworld,

Your problem could depend on your internal links:
Try to link the "Home" with the other pages by means of textual links,as some spiders have difficult to recognize non-textual links such as pictures ,animations,etc...

BTW don't display your real url in the posts or any personal data;is not allowed in this forum...



 11:29 am on Mar 21, 2005 (gmt 0)

Maybe you are using sessions. Normally the session information is stored in cookies. However, if a browser does not accept cookies (like Googlebot), the session ID is stored in an URL-Parameter like


Googlebot does not like those session IDs and does not follow the links.

The best way to avoid this is not to use sessions. The second best way is to check for "Googlebot" as agent description and to avoid using sessions for this agent.


 2:32 pm on Mar 21, 2005 (gmt 0)

i've seen google take a while to crawl much past the homepage of some new sites. could be sandbox related anyone thinks?


 3:12 pm on Mar 21, 2005 (gmt 0)

internal links were my problem - added textbased internal links, plus, adding robots.txt file seem to help, and a 'sitemap' page.



 5:01 pm on Mar 21, 2005 (gmt 0)

Google has had a general problem in indexing pages
for quite some time but they are not talking.
Thousands of pages are being shown as url only.
Eventually they may fix it but don't count on it
anytime soon.


 5:29 pm on Mar 21, 2005 (gmt 0)

Google has had a general problem in indexing pages
for quite some time but they are not talking.

Highly improbable.
Displayings only url is the result of web site design errors.

I never came across this problem managing my web sites.

Moreover the submission of Benindia is quite recent to support your explaination.


 6:23 am on Mar 22, 2005 (gmt 0)

just make sure you have a good ol HTML sitemap.
a robots.txt file
no sessions for googlebot.
Also for a new submission google will typically come and just look at the index page and go away for a while before coming back to crawl the site.
If it gets an updated index page every time it comes you may be causing it to loop through that first run again. So fix the index to what you like and link it to a sitemap and try leaving it alone for a bit.


 4:28 pm on Mar 22, 2005 (gmt 0)

I think you just need to be patient. Get a good one way link coming in to your site.

For the most part, your index page is probably not considered very strong by Google, thus they haven't taken the time to deep crawl your site yet. A few links should help that. Otherwise, just be patient, they'll get you soon enough.


 10:14 am on Mar 30, 2005 (gmt 0)

Hi to All,

I have read your valuable inputs regarding my website.
I would really really be obliged if you could help me, rank my website properly in Google.

I am suffering heavily.
The site is coming with exotic india crafts on the 160 Page.
No where with Sculptures, Textiles, Silver Sterling Jewelry, Glass Handicrafts Stain Glass Paintings, Brass Artifacts, brass bronze handicrafts and many many more.

It is not coming with any of my products.

I hope you understand my problem & help me getting my way through Google.


Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved