Welcome to WebmasterWorld Guest from 54.226.25.231

Message Too Old, No Replies

How to Tell Google That it's Ok to Index Rapidly?

i have 400,000,000 fresh pages converted from an old site on a new domain

     

NewSkool

8:12 pm on Apr 15, 2006 (gmt 0)



and they need quick indexing. let's say i trigger "google" and NOW it starts knowing about the home page of the new domain.

how long will it take google to index all these thousands of pages? can i tell google somehow that its okay to eat as much bandwidth as it wants? that I care about SEO so much?

BigDave

9:26 pm on Apr 15, 2006 (gmt 0)

WebmasterWorld Senior Member bigdave is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Four hundred million pages?!?!?!

Does your home page have PR10? Because there isn't much chance of EVER getting all those pages indexed without it.

What every big site needs, even if it is only in the 10,000 page range, is lots of deep links from external sites.

jrs_66

11:04 pm on Apr 15, 2006 (gmt 0)

10+ Year Member



NewSkool,

Congrats... you have the largest website in the world!

NewSkool

11:04 pm on Apr 15, 2006 (gmt 0)



hehe.

maybe i exxagerated a little.

it's more like 400,000,0 or so. the point is they're alot.

and no its not illegal just a pretty long running site with massive user content

any serious tips?

skippy

11:15 pm on Apr 15, 2006 (gmt 0)

10+ Year Member



Add a google sitemap. Might help.

inbound

11:22 pm on Apr 15, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



A serious tip/question would be:

Why are you changing the home of a site that has attracted 400,000,0 (sic) pages of user content?

Surely the 'old site' should be the one to concentrate on as whatever way the traffic is coming (google or not) there must be enough traffic to monetise.

NewSkool

11:46 pm on Apr 15, 2006 (gmt 0)



i dont care 1st about the money thats why.

NewSkool

5:09 pm on Apr 16, 2006 (gmt 0)



great nobody takes me seriously as always great...

jimbeetle

5:55 pm on Apr 16, 2006 (gmt 0)

WebmasterWorld Senior Member jimbeetle is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Big Dave basically answered your question.

What every big site needs, even if it is only in the 10,000 page range, is lots of deep links from external sites.

PR is one of the factors G uses to determine what to spider. More links > more PR > more spider activity.

NewSkool

5:57 pm on Apr 16, 2006 (gmt 0)



nobody links to me......

BigDave

5:57 pm on Apr 16, 2006 (gmt 0)

WebmasterWorld Senior Member bigdave is a WebmasterWorld Top Contributor of All Time 10+ Year Member



great nobody takes me seriously as always great...

You might want to go back and reread #2 and #6. Deep links and a sitemap is all that you can really do to speed things up.

You could also take the question in #6 more seriously if you want to be taken seriously. Not the money part, but the explanation of why you've gone and done such a damn fool thing when you seem to care about the traffic and being indexed.

There is no way to *make* google crawl your site faster or add it to the index faster. There are only ways to encourage this, and there are damn few ways to do that. Deep links from external sites, good on-site navigation and a google sitemap are the only ways that I know of.

Here is my rule of thumb: You can expect to have every page that has a decent incoming link in the index the first month. Every page that is one click away from those pages the next month. Go one more click farther every month after that.

But you need to have enough PR on any given page for google to consider it worth their time to go an addional level. Internal links from a PR0-1 page seem to have a pretty low priority when it comes time to schedule Googlebot.

For four million pages I would want to have at lest a PR7 homepage and a serious number of deep links. and I would figure on it taking google most of a year to index most of it.

BigDave

6:02 pm on Apr 16, 2006 (gmt 0)

WebmasterWorld Senior Member bigdave is a WebmasterWorld Top Contributor of All Time 10+ Year Member



nobody links to me......

Uh, how did all those users find you to generate that content?

If you don't have links, google will not care about you anyway. Even if you get in because of the sitemap, there is a really good chance that they will drop you after a few months.

Stop hanging out in the google search forum and head over to the link development forum. Then start following the advice in the archives.

DamonHD

6:13 pm on Apr 16, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi,

Also, it will help you with G and with us not to over-egg the pudding, what with 999999 reports by you of one "bad" site and 400,000,000 pages on your new site, etc, people cannot take you literally at your word can they?

Rgds

Damon

WW_Watcher

6:26 pm on Apr 16, 2006 (gmt 0)

10+ Year Member



If site with 400,000,000 pages is not worthy of linking to, people will not add to their favs either. Do your pocketbook (that you do not care about), and everyone who does not want to see it a favor. Stop spending money hosting it & hit the delete key.

Back to watching
WW_Watcher

walkman

7:49 pm on Apr 16, 2006 (gmt 0)



>> nobody links to me......

then those pages arent worth much--at least according to Google.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month