homepage Welcome to WebmasterWorld Guest from 54.237.99.131
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

This 37 message thread spans 2 pages: 37 ( [1] 2 > >     
Any sign of deepcrawl yet?
no signs here
Jimmie

10+ Year Member



 
Msg#: 8946 posted 5:29 pm on Jan 31, 2003 (gmt 0)

Just wondering if anyone has seen any signs of the deep crawl for next index yet....saw a few days back a mention of PR7 sites already being deep crawled..but I haven't seen anything yet on my site in terms of (216. IP) deep crawl

 

hskfun

10+ Year Member



 
Msg#: 8946 posted 5:32 pm on Jan 31, 2003 (gmt 0)

Wondering the same thing. Nothing here.
Daily freshbot visits, but nothing from 216.*

peterdaly

10+ Year Member



 
Msg#: 8946 posted 5:43 pm on Jan 31, 2003 (gmt 0)

That makes me feel a little better. I was worried the bots for the deep crawl may have for some reason forgotten about my sites. I would think it would be on my sites by now.

No sign of it here either. My main site is only a +5, but has been up for less than a year.

I was getting nervous, thanks for posting. :)

-Pete

lazyz

10+ Year Member



 
Msg#: 8946 posted 5:45 pm on Jan 31, 2003 (gmt 0)

When did Google crawl (216.#) for the last update? What date was the last deep crawl. (although I know the dates are slightly different but in general)

quotations

10+ Year Member



 
Msg#: 8946 posted 6:21 pm on Jan 31, 2003 (gmt 0)

I believe that I saw deep crawl IPs from the 3rd to the 11th of January.

Portalitalyzation

10+ Year Member



 
Msg#: 8946 posted 6:26 pm on Jan 31, 2003 (gmt 0)

Maybe, She Doesnt Want Go To Your Site at Same Time As Scooter, Fast, and INK

peterdaly

10+ Year Member



 
Msg#: 8946 posted 7:52 pm on Jan 31, 2003 (gmt 0)

I believe I had deep crawl going as late as the 15th, but don't hold me to that.

-Pete

Noximus

10+ Year Member



 
Msg#: 8946 posted 8:41 pm on Jan 31, 2003 (gmt 0)

No signs of deep crawl yet (six sites)

Noximus

hetzeld

10+ Year Member



 
Msg#: 8946 posted 8:43 pm on Jan 31, 2003 (gmt 0)

No sign of deepcrawl here in France...
5 sites from PR3 to PR7

Dan

taxpod

10+ Year Member



 
Msg#: 8946 posted 8:51 pm on Jan 31, 2003 (gmt 0)

No sign of deepcrawl here either. 3 sites, one a 5, two 6s but one of the 6s is a high 6 which has been to 7 twice in the past four months.

I have always seen Gbot in the 3-11 day of month slot.

Gringo

10+ Year Member



 
Msg#: 8946 posted 9:43 pm on Jan 31, 2003 (gmt 0)

I'v seen her twice, last time today at 15.12 GMT. IP was 216.239.39.5.

I'm using a cgi script called from my index page that sends me an email with the Googlebot IP whenever she passes by.

Don't know if this is relevant, but this particular site has only been online for 2 dances (less than 2 months) - maybe she wants to get all my deep new pages indexed :)

SubZeroGTS

10+ Year Member



 
Msg#: 8946 posted 10:07 pm on Jan 31, 2003 (gmt 0)

nothing yet, although Scooter and FAST's WebCrawler have been by.

maccas

10+ Year Member



 
Msg#: 8946 posted 10:46 pm on Jan 31, 2003 (gmt 0)

Deep crawling one of my sites since yesterday

Stefan

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 8946 posted 11:08 pm on Jan 31, 2003 (gmt 0)

No sign of it yet though the freshbot has been visiting my PR6 and PR5 pages. What is the PR of the index or main pages for the site that was crawled maccas?

maccas

10+ Year Member



 
Msg#: 8946 posted 11:22 pm on Jan 31, 2003 (gmt 0)

5 for index and the rest of the pages range from 3 - 6. Getting hit about once a minute from crawler10,11 and 12.

Stefan

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 8946 posted 11:34 pm on Jan 31, 2003 (gmt 0)

Well, there goes that theory. Thanks maccas.

ExtremeExports

10+ Year Member



 
Msg#: 8946 posted 11:50 pm on Jan 31, 2003 (gmt 0)

she hasn't been to any of my sites yet. PR 5 and PR4's

uber_boy

10+ Year Member



 
Msg#: 8946 posted 2:20 am on Feb 1, 2003 (gmt 0)

My understanding is that bots 10-12 are Freshbot and, if that's the case, the deep crawl has yet to commence. I routinely have 100K pages read in via the deep crawl over a period of a week so my opinion is that the deep crawl hasn't yet begun...

mayor

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 8946 posted 8:42 am on Feb 1, 2003 (gmt 0)

Only freshbot here!

Gringo

10+ Year Member



 
Msg#: 8946 posted 11:29 am on Feb 1, 2003 (gmt 0)

My site hit by the deep crawler is a PR5. Perhaps it's worth noting certain behaviour of this bot as posted here ...
[webmasterworld.com...]

Jimmie

10+ Year Member



 
Msg#: 8946 posted 4:35 pm on Feb 1, 2003 (gmt 0)

I pray google isn't out deep crawling my site today, my hosting company has had my server down for over 4 hours today......grrr....what is the typical monthly server downtime for a hosting company? sorry outside the topic briefly....

if anyone has seen the deep crawl, let me know

Stefan

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 8946 posted 7:28 pm on Feb 1, 2003 (gmt 0)

It hasn't been to my site as of 10 min's ago, Jimmie, although 64.68 took all my PR5 and PR6 pages last night. You have to think that the deepcrawl could start soon, so good luck with your hosting company.

ciml

WebmasterWorld Senior Member ciml us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 8946 posted 9:32 pm on Feb 1, 2003 (gmt 0)

Gringo, I think that 216.239.39.5 is a proxy. You need a visit from a 216.239 IP and with a Googlebot USER_AGENT.

I suspect it won't be too long now.

palmpal

10+ Year Member



 
Msg#: 8946 posted 9:40 pm on Feb 1, 2003 (gmt 0)

I also hope it is soon since my web host is planning an upgrade beginning Monday, February 3rd!

GeorgeGG

10+ Year Member



 
Msg#: 8946 posted 10:35 pm on Feb 1, 2003 (gmt 0)

I think that 216.239.39.5 is a proxy.

Agree, have them in my logs, some with a 'my' IP address
as the 'HTTP_X_FORWARDED_FOR' variable....

'HTTP_VIA' variable was '1.0 translate.google.com (TWS/0.9),
1.0 proxy.google.com:80 (Squid/2.3.STABLE4)'

'HTTP_REFERER' was
[216.239.39.120...]

UserAgent was my browser.

Was using,
Google Bar/ Page Info/ Translate into English
at the time.

GeorgeGG

hskfun

10+ Year Member



 
Msg#: 8946 posted 3:11 am on Feb 6, 2003 (gmt 0)

Finally, deep crawler is hitting my site...

mrkarron

10+ Year Member



 
Msg#: 8946 posted 3:31 am on Feb 6, 2003 (gmt 0)

Deep crawler just took my robots.txt file... Nice to see him back!

taxpod

10+ Year Member



 
Msg#: 8946 posted 3:37 am on Feb 6, 2003 (gmt 0)

I haven't seen HER for even one page view this month. Usually I see her by the 3rd or 4th.

Bio4ce

10+ Year Member



 
Msg#: 8946 posted 3:40 am on Feb 6, 2003 (gmt 0)

I think it's a proxy

216.239.46.3 @ Feb 05 21:34:56
64.68.82.56 @ Feb 05 22:03:51
64.68.82.50 @ Feb 05 22:14:48

Freshbot and deepcrawler within 45 minutes of each other?

Does that normally happen?

:)

amznVibe

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 8946 posted 4:08 am on Feb 6, 2003 (gmt 0)

30 minutes ago crawl4.googlebot.com (216.239.46.104)
18 hours ago crawler11.googlebot.com (64.68.82.58)
19 hours ago crawler10.googlebot.com (64.68.82.5)

This 37 message thread spans 2 pages: 37 ( [1] 2 > >
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved