Welcome to WebmasterWorld Guest from 23.20.223.88

Forum Moderators: open

Message Too Old, No Replies

Any sign of deepcrawl yet?

no signs here

     
5:29 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



Just wondering if anyone has seen any signs of the deep crawl for next index yet....saw a few days back a mention of PR7 sites already being deep crawled..but I haven't seen anything yet on my site in terms of (216. IP) deep crawl
5:32 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



Wondering the same thing. Nothing here.
Daily freshbot visits, but nothing from 216.*
5:43 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



That makes me feel a little better. I was worried the bots for the deep crawl may have for some reason forgotten about my sites. I would think it would be on my sites by now.

No sign of it here either. My main site is only a +5, but has been up for less than a year.

I was getting nervous, thanks for posting. :)

-Pete

5:45 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



When did Google crawl (216.#) for the last update? What date was the last deep crawl. (although I know the dates are slightly different but in general)
6:21 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



I believe that I saw deep crawl IPs from the 3rd to the 11th of January.
6:26 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



Maybe, She Doesnt Want Go To Your Site at Same Time As Scooter, Fast, and INK
7:52 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



I believe I had deep crawl going as late as the 15th, but don't hold me to that.

-Pete

8:41 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



No signs of deep crawl yet (six sites)

Noximus

8:43 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



No sign of deepcrawl here in France...
5 sites from PR3 to PR7

Dan

8:51 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



No sign of deepcrawl here either. 3 sites, one a 5, two 6s but one of the 6s is a high 6 which has been to 7 twice in the past four months.

I have always seen Gbot in the 3-11 day of month slot.

9:43 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



I'v seen her twice, last time today at 15.12 GMT. IP was 216.239.39.5.

I'm using a cgi script called from my index page that sends me an email with the Googlebot IP whenever she passes by.

Don't know if this is relevant, but this particular site has only been online for 2 dances (less than 2 months) - maybe she wants to get all my deep new pages indexed :)

10:07 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



nothing yet, although Scooter and FAST's WebCrawler have been by.
10:46 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



Deep crawling one of my sites since yesterday
11:08 pm on Jan 31, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No sign of it yet though the freshbot has been visiting my PR6 and PR5 pages. What is the PR of the index or main pages for the site that was crawled maccas?
11:22 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



5 for index and the rest of the pages range from 3 - 6. Getting hit about once a minute from crawler10,11 and 12.
11:34 pm on Jan 31, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Well, there goes that theory. Thanks maccas.
11:50 pm on Jan 31, 2003 (gmt 0)

10+ Year Member



she hasn't been to any of my sites yet. PR 5 and PR4's
2:20 am on Feb 1, 2003 (gmt 0)

10+ Year Member



My understanding is that bots 10-12 are Freshbot and, if that's the case, the deep crawl has yet to commence. I routinely have 100K pages read in via the deep crawl over a period of a week so my opinion is that the deep crawl hasn't yet begun...
8:42 am on Feb 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Only freshbot here!
11:29 am on Feb 1, 2003 (gmt 0)

10+ Year Member



My site hit by the deep crawler is a PR5. Perhaps it's worth noting certain behaviour of this bot as posted here ...
[webmasterworld.com...]
4:35 pm on Feb 1, 2003 (gmt 0)

10+ Year Member



I pray google isn't out deep crawling my site today, my hosting company has had my server down for over 4 hours today......grrr....what is the typical monthly server downtime for a hosting company? sorry outside the topic briefly....

if anyone has seen the deep crawl, let me know

7:28 pm on Feb 1, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It hasn't been to my site as of 10 min's ago, Jimmie, although 64.68 took all my PR5 and PR6 pages last night. You have to think that the deepcrawl could start soon, so good luck with your hosting company.
9:32 pm on Feb 1, 2003 (gmt 0)

WebmasterWorld Senior Member ciml is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Gringo, I think that 216.239.39.5 is a proxy. You need a visit from a 216.239 IP and with a Googlebot USER_AGENT.

I suspect it won't be too long now.

9:40 pm on Feb 1, 2003 (gmt 0)

10+ Year Member



I also hope it is soon since my web host is planning an upgrade beginning Monday, February 3rd!
10:35 pm on Feb 1, 2003 (gmt 0)

10+ Year Member



I think that 216.239.39.5 is a proxy.

Agree, have them in my logs, some with a 'my' IP address
as the 'HTTP_X_FORWARDED_FOR' variable....

'HTTP_VIA' variable was '1.0 translate.google.com (TWS/0.9),
1.0 proxy.google.com:80 (Squid/2.3.STABLE4)'

'HTTP_REFERER' was
[216.239.39.120...]

UserAgent was my browser.

Was using,
Google Bar/ Page Info/ Translate into English
at the time.

GeorgeGG

3:11 am on Feb 6, 2003 (gmt 0)

10+ Year Member



Finally, deep crawler is hitting my site...
3:31 am on Feb 6, 2003 (gmt 0)

10+ Year Member



Deep crawler just took my robots.txt file... Nice to see him back!
3:37 am on Feb 6, 2003 (gmt 0)

10+ Year Member



I haven't seen HER for even one page view this month. Usually I see her by the 3rd or 4th.
3:40 am on Feb 6, 2003 (gmt 0)

10+ Year Member



I think it's a proxy

216.239.46.3 @ Feb 05 21:34:56
64.68.82.56 @ Feb 05 22:03:51
64.68.82.50 @ Feb 05 22:14:48

Freshbot and deepcrawler within 45 minutes of each other?

Does that normally happen?

:)

4:08 am on Feb 6, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



30 minutes ago crawl4.googlebot.com (216.239.46.104)
18 hours ago crawler11.googlebot.com (64.68.82.58)
19 hours ago crawler10.googlebot.com (64.68.82.5)
This 37 message thread spans 2 pages: 37
 

Featured Threads

Hot Threads This Week

Hot Threads This Month