homepage Welcome to WebmasterWorld Guest from 54.197.110.151
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / WebmasterWorld / Webmaster General
Forum Library, Charter, Moderators: phranque

Webmaster General Forum

    
Super Massive sites
100,000 , 500,000, etc etc sites, except the BBC :)
vite_rts

5+ Year Member



 
Msg#: 12151 posted 5:14 pm on Jul 7, 2006 (gmt 0)

Hi Guys

I 've been wondering, do these sites with gigantic page numbers use some kinda automata to generate these pages?

or

do they create a page for each user like, say a forums,

so that each page is static html rather than dynamic, generated for each request

ergo, a ,,, classifieds site could have as many pages as individual items available for sale

 

monkeythumpa

10+ Year Member



 
Msg#: 12151 posted 5:40 pm on Jul 7, 2006 (gmt 0)

Most blogs only consist of one file that changes depending on the request.

Yes giant sites use a content management system, but so do small ones. It all looks the same to the browser though. Learn SQL and a whole bunch of opportunities will open up for you.

pageoneresults

WebmasterWorld Senior Member pageoneresults us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 12151 posted 5:44 pm on Jul 7, 2006 (gmt 0)

I 've been wondering, do these sites with gigantic page numbers use some kinda automata to generate these pages?

Yes, most everything is served from a database based on the query. You can literally build 5-10 template pages capable of generating millions of pages. The only limit is how many products are in the database. If you have 5,000,000 products, you can easily generate 5,000,000 pages.

vite_rts

5+ Year Member



 
Msg#: 12151 posted 5:54 pm on Jul 7, 2006 (gmt 0)

I am familiar with ASP.net, but the page is generated for each request, consequently, the content is dynamic,

But I guess you're saying that these sites actually generate a static html page which is fixed an unchanging thereafter?

pageoneresults

WebmasterWorld Senior Member pageoneresults us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 12151 posted 5:56 pm on Jul 7, 2006 (gmt 0)

But I guess you're saying that these sites actually generate a static html page which is fixed an unchanging thereafter?

No static pages, that's old school stuff.

No, these pages are generated dynamically on the fly based on the query. More like a virtual page. You need to build the core pages which contain the queries and then let the spiders do their thing from there.

PhraSEOlogy

10+ Year Member



 
Msg#: 12151 posted 6:03 pm on Jul 7, 2006 (gmt 0)

I use a database to generate thousands of static html pages which are rebuilt every week or so. The pages load faster and dont have to access the database server continually (just once per week).

For me it a nice middle ground that allows me to be a little more creative/inventive when building the pages from the database. Static pages also have a SE friendly url without the need for mod_rewrite for dynamic pages.

[edited by: PhraSEOlogy at 6:06 pm (utc) on July 7, 2006]

vite_rts

5+ Year Member



 
Msg#: 12151 posted 6:05 pm on Jul 7, 2006 (gmt 0)

Agghhh,, I have this picture in my head off the google spider.,,,,, pushing its way thru this kinda site,,, and actually generating the site by "stepping" on the links, triggering the query on the link,,,

Then the 100,000 pages vamoose as soon as the spider is gone,

or perhaps, the way the spider works causes the individual pages to exist when it follows an internal path way,,, till it exits the website

PhraSEOlogy

10+ Year Member



 
Msg#: 12151 posted 6:11 pm on Jul 7, 2006 (gmt 0)

vite_rts,

Think of dynamic pages as a "bridge" to the real data (or page content) in the database. The data exists irrespective of type of page (static/dynamic). Dynamic pages just take out the process of having to convert the data to a static page.

pageoneresults

WebmasterWorld Senior Member pageoneresults us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 12151 posted 6:35 pm on Jul 7, 2006 (gmt 0)

Then the 100,000 pages vamoose as soon as the spider is gone.

Actually the pages do not "physically" exist. They are dynamic. Once the spider indexes those 100,000 pages, they've now generated those pages for their index. They don't exist from a physical standpoint.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / WebmasterWorld / Webmaster General
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved