Welcome to WebmasterWorld Guest from 107.22.83.0

Forum Moderators: open

Message Too Old, No Replies

Any sign of deepcrawl yet?

no signs here

     
5:29 pm on Jan 31, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 28, 2002
posts:66
votes: 0


Just wondering if anyone has seen any signs of the deep crawl for next index yet....saw a few days back a mention of PR7 sites already being deep crawled..but I haven't seen anything yet on my site in terms of (216. IP) deep crawl
5:32 pm on Jan 31, 2003 (gmt 0)

New User

10+ Year Member

joined:Aug 29, 2002
posts:14
votes: 0


Wondering the same thing. Nothing here.
Daily freshbot visits, but nothing from 216.*
5:43 pm on Jan 31, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Dec 30, 2002
posts:437
votes: 0


That makes me feel a little better. I was worried the bots for the deep crawl may have for some reason forgotten about my sites. I would think it would be on my sites by now.

No sign of it here either. My main site is only a +5, but has been up for less than a year.

I was getting nervous, thanks for posting. :)

-Pete

5:45 pm on Jan 31, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Jan 28, 2002
posts:240
votes: 0


When did Google crawl (216.#) for the last update? What date was the last deep crawl. (although I know the dates are slightly different but in general)
6:21 pm on Jan 31, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Sept 25, 2002
posts:407
votes: 0


I believe that I saw deep crawl IPs from the 3rd to the 11th of January.
6:26 pm on Jan 31, 2003 (gmt 0)

New User

10+ Year Member

joined:Jan 28, 2003
posts:3
votes: 0


Maybe, She Doesnt Want Go To Your Site at Same Time As Scooter, Fast, and INK
7:52 pm on Jan 31, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Dec 30, 2002
posts:437
votes: 0


I believe I had deep crawl going as late as the 15th, but don't hold me to that.

-Pete

8:41 pm on Jan 31, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 7, 2002
posts:403
votes: 0


No signs of deep crawl yet (six sites)

Noximus

8:43 pm on Jan 31, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Dec 5, 2002
posts:219
votes: 0


No sign of deepcrawl here in France...
5 sites from PR3 to PR7

Dan

8:51 pm on Jan 31, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:May 1, 2002
posts:439
votes: 0


No sign of deepcrawl here either. 3 sites, one a 5, two 6s but one of the 6s is a high 6 which has been to 7 twice in the past four months.

I have always seen Gbot in the 3-11 day of month slot.

Gringo

9:43 pm on Jan 31, 2003 (gmt 0)

Inactive Member
Account Expired

 
 


I'v seen her twice, last time today at 15.12 GMT. IP was 216.239.39.5.

I'm using a cgi script called from my index page that sends me an email with the Googlebot IP whenever she passes by.

Don't know if this is relevant, but this particular site has only been online for 2 dances (less than 2 months) - maybe she wants to get all my deep new pages indexed :)

10:07 pm on Jan 31, 2003 (gmt 0)

New User

10+ Year Member

joined:Jan 24, 2003
posts:40
votes: 0


nothing yet, although Scooter and FAST's WebCrawler have been by.
10:46 pm on Jan 31, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 30, 2000
posts:497
votes: 0


Deep crawling one of my sites since yesterday
11:08 pm on Jan 31, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


No sign of it yet though the freshbot has been visiting my PR6 and PR5 pages. What is the PR of the index or main pages for the site that was crawled maccas?
11:22 pm on Jan 31, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Oct 30, 2000
posts:497
votes: 0


5 for index and the rest of the pages range from 3 - 6. Getting hit about once a minute from crawler10,11 and 12.
11:34 pm on Jan 31, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


Well, there goes that theory. Thanks maccas.
11:50 pm on Jan 31, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 13, 2002
posts:136
votes: 0


she hasn't been to any of my sites yet. PR 5 and PR4's
2:20 am on Feb 1, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 3, 2003
posts:58
votes: 0


My understanding is that bots 10-12 are Freshbot and, if that's the case, the deep crawl has yet to commence. I routinely have 100K pages read in via the deep crawl over a period of a week so my opinion is that the deep crawl hasn't yet begun...
8:42 am on Feb 1, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:June 29, 2000
posts:1133
votes: 0


Only freshbot here!

Gringo

11:29 am on Feb 1, 2003 (gmt 0)

Inactive Member
Account Expired

 
 


My site hit by the deep crawler is a PR5. Perhaps it's worth noting certain behaviour of this bot as posted here ...
[webmasterworld.com...]
4:35 pm on Feb 1, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 28, 2002
posts:66
votes: 0


I pray google isn't out deep crawling my site today, my hosting company has had my server down for over 4 hours today......grrr....what is the typical monthly server downtime for a hosting company? sorry outside the topic briefly....

if anyone has seen the deep crawl, let me know

7:28 pm on Feb 1, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


It hasn't been to my site as of 10 min's ago, Jimmie, although 64.68 took all my PR5 and PR6 pages last night. You have to think that the deepcrawl could start soon, so good luck with your hosting company.
9:32 pm on Feb 1, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member ciml is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 22, 2001
posts:3805
votes: 2


Gringo, I think that 216.239.39.5 is a proxy. You need a visit from a 216.239 IP and with a Googlebot USER_AGENT.

I suspect it won't be too long now.

9:40 pm on Feb 1, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Sept 19, 2002
posts:257
votes: 0


I also hope it is soon since my web host is planning an upgrade beginning Monday, February 3rd!
10:35 pm on Feb 1, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 6, 2002
posts:191
votes: 0


I think that 216.239.39.5 is a proxy.

Agree, have them in my logs, some with a 'my' IP address
as the 'HTTP_X_FORWARDED_FOR' variable....

'HTTP_VIA' variable was '1.0 translate.google.com (TWS/0.9),
1.0 proxy.google.com:80 (Squid/2.3.STABLE4)'

'HTTP_REFERER' was
[216.239.39.120...]

UserAgent was my browser.

Was using,
Google Bar/ Page Info/ Translate into English
at the time.

GeorgeGG

3:11 am on Feb 6, 2003 (gmt 0)

New User

10+ Year Member

joined:Aug 29, 2002
posts:14
votes: 0


Finally, deep crawler is hitting my site...
3:31 am on Feb 6, 2003 (gmt 0)

New User

10+ Year Member

joined:Nov 28, 2002
posts:24
votes: 0


Deep crawler just took my robots.txt file... Nice to see him back!
3:37 am on Feb 6, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:May 1, 2002
posts:439
votes: 0


I haven't seen HER for even one page view this month. Usually I see her by the 3rd or 4th.
3:40 am on Feb 6, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 29, 2002
posts:130
votes: 0


I think it's a proxy

216.239.46.3 @ Feb 05 21:34:56
64.68.82.56 @ Feb 05 22:03:51
64.68.82.50 @ Feb 05 22:14:48

Freshbot and deepcrawler within 45 minutes of each other?

Does that normally happen?

:)

4:08 am on Feb 6, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 16, 2002
posts:2010
votes: 0


30 minutes ago crawl4.googlebot.com (216.239.46.104)
18 hours ago crawler11.googlebot.com (64.68.82.58)
19 hours ago crawler10.googlebot.com (64.68.82.5)
This 37 message thread spans 2 pages: 37