homepage Welcome to WebmasterWorld Guest from 23.20.77.156
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

This 37 message thread spans 2 pages: 37 ( [1] 2 > >     
Any sign of deepcrawl yet?
no signs here
Jimmie




msg:56538
 5:29 pm on Jan 31, 2003 (gmt 0)

Just wondering if anyone has seen any signs of the deep crawl for next index yet....saw a few days back a mention of PR7 sites already being deep crawled..but I haven't seen anything yet on my site in terms of (216. IP) deep crawl

 

hskfun




msg:56539
 5:32 pm on Jan 31, 2003 (gmt 0)

Wondering the same thing. Nothing here.
Daily freshbot visits, but nothing from 216.*

peterdaly




msg:56540
 5:43 pm on Jan 31, 2003 (gmt 0)

That makes me feel a little better. I was worried the bots for the deep crawl may have for some reason forgotten about my sites. I would think it would be on my sites by now.

No sign of it here either. My main site is only a +5, but has been up for less than a year.

I was getting nervous, thanks for posting. :)

-Pete

lazyz




msg:56541
 5:45 pm on Jan 31, 2003 (gmt 0)

When did Google crawl (216.#) for the last update? What date was the last deep crawl. (although I know the dates are slightly different but in general)

quotations




msg:56542
 6:21 pm on Jan 31, 2003 (gmt 0)

I believe that I saw deep crawl IPs from the 3rd to the 11th of January.

Portalitalyzation




msg:56543
 6:26 pm on Jan 31, 2003 (gmt 0)

Maybe, She Doesnt Want Go To Your Site at Same Time As Scooter, Fast, and INK

peterdaly




msg:56544
 7:52 pm on Jan 31, 2003 (gmt 0)

I believe I had deep crawl going as late as the 15th, but don't hold me to that.

-Pete

Noximus




msg:56545
 8:41 pm on Jan 31, 2003 (gmt 0)

No signs of deep crawl yet (six sites)

Noximus

hetzeld




msg:56546
 8:43 pm on Jan 31, 2003 (gmt 0)

No sign of deepcrawl here in France...
5 sites from PR3 to PR7

Dan

taxpod




msg:56547
 8:51 pm on Jan 31, 2003 (gmt 0)

No sign of deepcrawl here either. 3 sites, one a 5, two 6s but one of the 6s is a high 6 which has been to 7 twice in the past four months.

I have always seen Gbot in the 3-11 day of month slot.

Gringo




msg:56548
 9:43 pm on Jan 31, 2003 (gmt 0)

I'v seen her twice, last time today at 15.12 GMT. IP was 216.239.39.5.

I'm using a cgi script called from my index page that sends me an email with the Googlebot IP whenever she passes by.

Don't know if this is relevant, but this particular site has only been online for 2 dances (less than 2 months) - maybe she wants to get all my deep new pages indexed :)

SubZeroGTS




msg:56549
 10:07 pm on Jan 31, 2003 (gmt 0)

nothing yet, although Scooter and FAST's WebCrawler have been by.

maccas




msg:56550
 10:46 pm on Jan 31, 2003 (gmt 0)

Deep crawling one of my sites since yesterday

Stefan




msg:56551
 11:08 pm on Jan 31, 2003 (gmt 0)

No sign of it yet though the freshbot has been visiting my PR6 and PR5 pages. What is the PR of the index or main pages for the site that was crawled maccas?

maccas




msg:56552
 11:22 pm on Jan 31, 2003 (gmt 0)

5 for index and the rest of the pages range from 3 - 6. Getting hit about once a minute from crawler10,11 and 12.

Stefan




msg:56553
 11:34 pm on Jan 31, 2003 (gmt 0)

Well, there goes that theory. Thanks maccas.

ExtremeExports




msg:56554
 11:50 pm on Jan 31, 2003 (gmt 0)

she hasn't been to any of my sites yet. PR 5 and PR4's

uber_boy




msg:56555
 2:20 am on Feb 1, 2003 (gmt 0)

My understanding is that bots 10-12 are Freshbot and, if that's the case, the deep crawl has yet to commence. I routinely have 100K pages read in via the deep crawl over a period of a week so my opinion is that the deep crawl hasn't yet begun...

mayor




msg:56556
 8:42 am on Feb 1, 2003 (gmt 0)

Only freshbot here!

Gringo




msg:56557
 11:29 am on Feb 1, 2003 (gmt 0)

My site hit by the deep crawler is a PR5. Perhaps it's worth noting certain behaviour of this bot as posted here ...
[webmasterworld.com...]

Jimmie




msg:56558
 4:35 pm on Feb 1, 2003 (gmt 0)

I pray google isn't out deep crawling my site today, my hosting company has had my server down for over 4 hours today......grrr....what is the typical monthly server downtime for a hosting company? sorry outside the topic briefly....

if anyone has seen the deep crawl, let me know

Stefan




msg:56559
 7:28 pm on Feb 1, 2003 (gmt 0)

It hasn't been to my site as of 10 min's ago, Jimmie, although 64.68 took all my PR5 and PR6 pages last night. You have to think that the deepcrawl could start soon, so good luck with your hosting company.

ciml




msg:56560
 9:32 pm on Feb 1, 2003 (gmt 0)

Gringo, I think that 216.239.39.5 is a proxy. You need a visit from a 216.239 IP and with a Googlebot USER_AGENT.

I suspect it won't be too long now.

palmpal




msg:56561
 9:40 pm on Feb 1, 2003 (gmt 0)

I also hope it is soon since my web host is planning an upgrade beginning Monday, February 3rd!

GeorgeGG




msg:56562
 10:35 pm on Feb 1, 2003 (gmt 0)

I think that 216.239.39.5 is a proxy.

Agree, have them in my logs, some with a 'my' IP address
as the 'HTTP_X_FORWARDED_FOR' variable....

'HTTP_VIA' variable was '1.0 translate.google.com (TWS/0.9),
1.0 proxy.google.com:80 (Squid/2.3.STABLE4)'

'HTTP_REFERER' was
[216.239.39.120...]

UserAgent was my browser.

Was using,
Google Bar/ Page Info/ Translate into English
at the time.

GeorgeGG

hskfun




msg:56563
 3:11 am on Feb 6, 2003 (gmt 0)

Finally, deep crawler is hitting my site...

mrkarron




msg:56564
 3:31 am on Feb 6, 2003 (gmt 0)

Deep crawler just took my robots.txt file... Nice to see him back!

taxpod




msg:56565
 3:37 am on Feb 6, 2003 (gmt 0)

I haven't seen HER for even one page view this month. Usually I see her by the 3rd or 4th.

Bio4ce




msg:56566
 3:40 am on Feb 6, 2003 (gmt 0)

I think it's a proxy

216.239.46.3 @ Feb 05 21:34:56
64.68.82.56 @ Feb 05 22:03:51
64.68.82.50 @ Feb 05 22:14:48

Freshbot and deepcrawler within 45 minutes of each other?

Does that normally happen?

:)

amznVibe




msg:56567
 4:08 am on Feb 6, 2003 (gmt 0)

30 minutes ago crawl4.googlebot.com (216.239.46.104)
18 hours ago crawler11.googlebot.com (64.68.82.58)
19 hours ago crawler10.googlebot.com (64.68.82.5)

This 37 message thread spans 2 pages: 37 ( [1] 2 > >
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved