homepage Welcome to WebmasterWorld Guest from 54.205.207.53
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

    
Daily Deep Crawl
Does your site get one?
BMach

10+ Year Member



 
Msg#: 23621 posted 4:44 am on Apr 27, 2004 (gmt 0)

Starting a new thread on this one...I am trying to figure out what it takes to get a daily deep crawl like some sites I have seen. I am thinking that you need a PR of over 5 maybe even 6. Does anyone have a site that gets a daily deep crawl and if so what is your site's PR? Thanks.

 

lunarboy1

10+ Year Member



 
Msg#: 23621 posted 4:19 am on Apr 28, 2004 (gmt 0)

Every couple of days (2-4) i have a PR 5. It is php dynamic stuff which probably helps.

BigDave

WebmasterWorld Senior Member bigdave us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 23621 posted 4:53 am on Apr 28, 2004 (gmt 0)

How big of a site are you talking about? I have around 8,000 pages with a pr7 home page. Google requests around 25,000 pages a month. <added>but it does pick up new pages within a few hours.</added>

Do you really have that many pages that change on a daily basis? Not even forums change that much on more than a few of their pages.

PizdusInc

10+ Year Member



 
Msg#: 23621 posted 8:09 am on Apr 28, 2004 (gmt 0)

PR6 site here... Google crawls pretty much the whole thing every day.

Kind of odd, but keeps results fresh.

Umbertide

10+ Year Member



 
Msg#: 23621 posted 9:15 am on Apr 28, 2004 (gmt 0)

yeah we have moved up to PR6 and our site (1000 pages) is heavily spidered most days. When we were PR 5 we had a daily visit but nothing amazing. I reckon there's a correlation here. We got a link from a really good PR8 site and since then googlebot has been a lot more hungrier and come looking much more.

webnewton

10+ Year Member



 
Msg#: 23621 posted 11:52 am on Apr 28, 2004 (gmt 0)

My sites have almost daily deep crawl. I think the reason must be daily updates on the sites.
Also there is this site where updates aren't much but yes we do agressive bloging for the site. Bot remains there almost everyday.
East, West, North OR South, Wherever spider is visiting you should have your link there. Spider will come to you.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved