Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Custom search on a 200k page site - wait for all pages to be crawled?

         

moshebar

12:38 pm on Feb 14, 2009 (gmt 0)

10+ Year Member



hey,

i have a website with 200k (each one will be on a unique page and so on) that i was paid by someone to do for him (don't care why he wants it).

the thing is - i want to use google custom search, but the problem is that i just registered the website to google SE and Webmaster tools, and i have no idea how much time it's going to take google to crawl the 200k pages.

so should i wait for google to crawl the 200k pages and then offer the custom search for the users, or what ?

from your experience - how much time should it take google to crawl 200k unique-text pages ?

thanks

[edited by: caveman at 8:55 pm (utc) on Feb. 14, 2009]
[edit reason] removed specifics [/edit]

gldean

1:42 pm on Feb 14, 2009 (gmt 0)

10+ Year Member



I would like to know this as well but not sure if there is a way of knowing. Does google crawl your entire site before indexing?

GD

moshebar

1:46 pm on Feb 14, 2009 (gmt 0)

10+ Year Member



that's why i was pointing the question for people that have experience with a large amount of indexed pages :)
there are many of those people in this forum (or at least i hope so ..)

Excellira

3:23 am on Feb 27, 2009 (gmt 0)

10+ Year Member



There is no need to wait for the site to be indexed by the SE. Site Search indexing and SE indexing are separate functions.

It will take a while for all 200K of your pages are indexed in the SE but you can request that SS index your pages and they will do so quite quickly (as I recall about 24 hours). You can request this within the SS account manager. This request will not help your search engine indexing.

One additional benefit to SS is that the internally searched terms are reported within your webmaster tools account. Useful from the perspective of usability, content creation, and merchandising.

moshebar

2:58 pm on Feb 27, 2009 (gmt 0)

10+ Year Member



but doesn't the fast (24 hours) SS indexing cost a lot of money?
or am i confusing it with paid-SE inexing ?

Excellira

3:57 pm on Feb 27, 2009 (gmt 0)

10+ Year Member



No. Take a looK: [google.com...]

More info:
[google.com...]