Forum Moderators: open

Message Too Old, No Replies

deep crawling?

         

icebane

10:12 am on Dec 23, 2003 (gmt 0)

10+ Year Member



Has anyone been experience a lack of deep crawling the past week?

Thanks for any info.

Chico_Loco

1:59 am on Dec 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Actually - GoogleBot is whacking my site today (no problems with that mind you..).

I've been "tail grepping" the log for the past few hours and it's hit me over 250 times today.. can't complain :)

Still over 300 pages to find GoogleBot - keep digging :P

Hollywood

2:33 am on Dec 28, 2003 (gmt 0)

10+ Year Member Top Contributors Of The Month



Just saw results pulled from www-in.google.

Another Google-update? Also saw diff. totals for links for Yahoo and others.

... then it reverted back to the regular most recent index www.google; this gets me dizzy, I forget if this is even normal anymore, then again what is in our SEO world.

What say you all?

Hollywood

kevinpate

3:13 am on Dec 28, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



1-Adam-12,1-Adam-12, see the webhead at domain & org.
Apparent feeding frenzy in progress.

Webhead reports multiple googlebots running wild and
free across common logs.

Be advised multipleother bots have been spotted rustling over the same logs.

Proceed with caution, Code 2.

BroadProspect

2:11 pm on Dec 29, 2003 (gmt 0)

10+ Year Member



FYI, googlebot is crawling again after a few days of no activity many of the sites the crawler alert service is monitoring
/BP

kelleybelly

5:21 am on Dec 30, 2003 (gmt 0)

10+ Year Member



Does anyone know how long at this point it takes a 8 month old site be be deep crawled that is already indexed in google?

dvduval

5:31 am on Dec 30, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I got one of the deepest crawls of my phpbb forum that I've seen in months today. I think googlebot is getting busy once again.

marcus anthony

12:01 pm on Dec 30, 2003 (gmt 0)

10+ Year Member



We had verry litle activity from googlebot with it only spidering the index page, until last night when it spidered all 283 pages.
However are page rank is still zerro, can someone clarify how many back links we need and what else helps with page ranking.

Thanks in advance

JoeyBall

12:35 pm on Dec 30, 2003 (gmt 0)

10+ Year Member



My site was recently exluded from google and saw no googlebot activity.

yesterday i had 118 sessions something like that, does that mean my site will be reincluded on google.

i have had no google activity for the past 4 weeks now and yesterday was a huge suprise

webdude

1:23 pm on Dec 30, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I definitely had a deep crawl recently. Hit every page I had. Good to see some activity again.

peterdaly

2:03 pm on Dec 30, 2003 (gmt 0)

10+ Year Member



The "deep crawl" I (we) was talking about earlier in the thread appears to me not to be a true deep crawl. I had about 2500 never indexed pages crawled as part of that which started showing up in the live index last night.

That tells me either the deep crawl behavior have changed quite a lot, or it was really a coordinated deep fresh crawl.

Thoughts?

brakkar

2:34 pm on Dec 30, 2003 (gmt 0)

10+ Year Member



I don't think there should be a deep crawl now.

Like a week ago, my site got its PR from 4 to 6, and this update hasn't run across all servers as I often get then old ranking, and I doubt the deep crawl will begin until the update is done on all servers.

Brakkar

Dayo_UK

2:43 pm on Dec 30, 2003 (gmt 0)



In my experience.

Last couple of times the deepcrawl has started as soon or soon after PR and Backlinks were updated.

Have had about 10,000 visits from Google over the last few days (since about 27th) - so if it aint a deep crawl I dont know what it is.

JoeyBall

9:49 am on Dec 31, 2003 (gmt 0)

10+ Year Member



If someone could answer me this one question, how often does google 2.1 access a site? is it everyday

kevinpate

12:14 pm on Dec 31, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



> how often does google 2.1 access a site?

That will vary from site to site, depending on site size, inbound links,pr,internal link structure, etc.

On some sites the googlebot(s) is/are popping in and out 24/7 all year long. On other sites, the visitation frequency from googlebot(s) is/are much lower.

JoeyBall

12:24 pm on Dec 31, 2003 (gmt 0)

10+ Year Member



Hi Kevin,

My site is a pr 6

Hollywood

5:11 pm on Dec 31, 2003 (gmt 0)

10+ Year Member Top Contributors Of The Month



Just had four sites reach Google PR=6 this AM; does appear Google is updating fast and furious.

Hollywood

phxmichael

7:16 pm on Dec 31, 2003 (gmt 0)

10+ Year Member



Before Florida, we'd get the googlebot almost everyday. No we see it once a week, and only for a few pages in a 500 page site.

Temporary or the way of things to be?

This 77 message thread spans 3 pages: 77