Welcome to WebmasterWorld Guest from 54.157.239.93

Forum Moderators: open

Message Too Old, No Replies

Getting large content indexed

dealing with pagination...

     
1:58 pm on Apr 23, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 13, 2003
posts:83
votes: 0


Hi,

I currently have a site that has a large number of stories (1400+) that I would like indexed.

However, it uses a typical pagination scheme, and I am not quite sure how google will be able to see all the stories.

It goes something like this:

www.mydomain.com/story.php?page=****
where **** will display a page containing 20 stories at a time. At the bottom of the page it has a typical 'PREV 1 2 3 4 5 NEXT' kind of setup. The way I figure though, google would have to crawl something like 15 pages deep (1400/20/5) in order to see all of the content.

each story on those pages is linked to showstory.php?a=**** where xxx is the story name. ( I was cautious to avoid using 'id' ).

How can I best setup these pages so google can access every story? I was considering adding a separate page that just listed all of the 'pages', which would only be about 70 or so. ( it would just have a list of links like story.php?page=1 , story.php?page=2 ... all the way to the last page ). This way each page listing would only be about 2 links deep.

How do you guys handle this?

-N

5:07 pm on Apr 29, 2004 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 22, 2003
posts:1483
votes: 0


>> At the bottom of the page it has a typical 'PREV 1 2 3 4 5 NEXT' kind of setup.

My experience (with asp) has been that Googlebot's better at hitting "NEXT" than many users. :) :(

>>I was considering adding a separate page that just listed all of the 'pages', which would only be about 70 or so.

That should speed things up. Make it palatable for users too, call it a 'site map', and link to it from your home page.

5:12 pm on Apr 29, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member googleguy is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Oct 8, 2001
posts:2882
votes: 0


Yah, site maps are your friend here. Someone from a small news site asked me about this once. I recommened breaking the stories down chronologically: Stories from
2004, 2003, 2002, ..., 2000
And then on those pages, stories from
January, ..., December
and then on those pages, links to all the stories that month. If you only have 1400 stories, you might be able to combine the month and year pages, e.g.
- Stories from January, 2000
- Stories from February, 2000
- ...
- Stories from April, 2004
and then on each page, you can link to the stories for that month.

There's lots of other ways to break a site map up (alphabetically, by topic, etc. etc.), so I'd look for a solution that's intuitive for users and that at the same time has pretty high fanout (you don't want your sitemap to be 7 levels deep; 1-3 levels deep is much better), while keeping individual pages under 100K or so.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members