Forum Moderators: open

Message Too Old, No Replies

Will Google Spider A Long Page with nothing but text?

         

jseamless

7:14 pm on Apr 3, 2004 (gmt 0)

10+ Year Member



Should you keep the length of your page to a certain size?

jbinbpt

7:59 pm on Apr 3, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to Webmasterworld.......

Your page size is dependent on content. If it makes a good read it can be long. It should be long enough to hold the reader’s interest without hitting the back button.

There have been many threads here about page length and the reading habits of web users. In general, you need to hook a reader on what first displays on the screen. The reader will as easily press the back button instead of scrolling or page down.

As far as a file size for spidering, keeping below 100k is a good goal.

jb

jseamless

11:19 pm on Apr 3, 2004 (gmt 0)

10+ Year Member



Thanks for the reply! I guess I should have been more clear. I have a glossary page. I want to make sure the whole page is indexed. I was not sure if I should break the page up into a couple pages. It is 92k in size.

robotsdobetter

11:58 pm on Apr 3, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I like to break the pages up, so the user(s) don't have to keep going down and down.

Robots only index so much of the page, so you might want to break it down.

bufferzone

12:37 am on Apr 4, 2004 (gmt 0)

10+ Year Member



As you will find out if you do a little reading in webmasterworld, Content is a big factor in placement. The more content the merrier. Content to some extent is number of pages with text on them. This means that instead of having a few very long articles, it is better to divide the very long articles up and have several smaller articles. Another thing is that it is easier to optimise your site to more keywords if you have more separate pages to optimize, it means less keywords pr. Page which lends more weight to each keyword

john30

3:56 am on Apr 4, 2004 (gmt 0)

10+ Year Member



If you can get the page to be spidered, everything will be indexed up to 115k. After that, any information will be truncated from the searchable index.

GoogleGuy

4:49 am on Apr 5, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



We'll typically index the first 101K of a web page--in practice, more content of a page can be indexed (e.g. PDFs), but if you keep your main content under 100K or so, that's the safest.

caspita

10:40 pm on May 7, 2004 (gmt 0)

10+ Year Member



Total size or jut text?

Does it google matter the total size or just the text size? I have some pages that are beyond the 100K, but it is beacuse those have two or three high resolution images, but if you count only text those are only 30 - 40 k

Should I take out the images for the spider?

Thanks,

Carlos.

Elijah

10:54 pm on May 7, 2004 (gmt 0)

10+ Year Member



Total size or jut text?

Does it google matter the total size or just the text size? I have some pages that are beyond the 100K, but it is beacuse those have two or three high resolution images, but if you count only text those are only 30 - 40 k

Should I take out the images for the spider?


I'm pretty sure that it is text + HTML. Images should not count toward total indexed page size.

Stefan

11:34 pm on May 7, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Total size or jut text?

The regular Gbot just looks at the .html, .txt, .doc, whatever. The pics are crawled by a separate bot, the imagebot. The 101 k is text only and doesn't include images.

In fact, the regular bot goes much deeper than 101k, (we have an .html page, 439k, that Gbot took all of a couple of days ago... a long list of over a thousand cave positions), it just seems to cache and use kw's for the first 101k. It will grab links from further than 101k. Still, it's best to keep the .htm under 101.