Welcome to WebmasterWorld Guest from 54.204.107.91

Forum Moderators: open

Message Too Old, No Replies

Deepbot is in the house....

I just seen deepbot on my server all

     
10:30 pm on Apr 15, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:June 15, 2002
posts:396
votes: 0


Its deepbot time!

teeceo.

10:30 pm on Apr 15, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Jan 11, 2003
posts:442
votes: 0


It is. Just posted some log entries in another thread. It just started.
10:32 pm on Apr 15, 2003 (gmt 0)

Senior Member from MY 

WebmasterWorld Senior Member vincevincevince is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 1, 2003
posts:4847
votes: 0


<cries> It's too early! I need time to fix the troubles I just found from the last update </cries>
10:35 pm on Apr 15, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:June 15, 2002
posts:396
votes: 0


Its true.

teeceo.

216.239.46.206 - - [15/Apr/2003:15:16:55 -0700] "GET /robots.txt HTTP/1.0" 404 - "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

10:36 pm on Apr 15, 2003 (gmt 0)

New User

10+ Year Member

joined:Apr 14, 2003
posts:6
votes: 0


Yeah deep is just started on my site too..
10:40 pm on Apr 15, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 17, 2003
posts:172
votes: 0


Hello Mr. Deep, cmon in. Here too, good thing I'm done!
10:41 pm on Apr 15, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 27, 2002
posts:1685
votes: 0


216.239.46.78

crawl3.googlebot.com - - [15/Apr/2003:15:26:57 -0700] "GET /robots.txt HTTP/1.0" 200 220 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

Ok. Works for me.

Pendanticist.

11:29 pm on Apr 15, 2003 (gmt 0)

New User

10+ Year Member

joined:Mar 9, 2003
posts:26
votes: 0


216.* is on my site also. Will it come back and double check everything. So that if I make changes now, will they register if it comes back?
11:36 pm on Apr 15, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:July 24, 2002
posts:135
votes: 0


Please come visit me you sexy lil deepcrawler you..
11:38 pm on Apr 15, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Sept 2, 2002
posts:446
votes: 0


Deepbot is on my site too. Just started within past hour. (PR6 site)
12:03 am on Apr 16, 2003 (gmt 0)

New User

10+ Year Member

joined:Apr 1, 2003
posts:37
votes: 0


/me lays out the milk and cookies come and get um deep! Crawl it baby! My bandwidth for you!
12:17 am on Apr 16, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 17, 2003
posts:172
votes: 0


>>Will it come back and double check everything.

Wouldn't that mean reading the entire web in twice? Doesn't make sense on their part. I was wondering if Deepbot took Freshbot's updates before compiling the cycle but couldn't find the info with the search..

12:30 am on Apr 16, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 16, 2002
posts:2133
votes: 1


Just like Gollum....
12:33 am on Apr 16, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


2003-04-15 23:14:29 216.239.46.104

Right on schedule...

1:07 am on Apr 16, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Apr 7, 2003
posts:540
votes: 0


Showed up here too, just a while ago. Better finish what I'm doing :)
1:45 am on Apr 16, 2003 (gmt 0)

New User

10+ Year Member

joined:Feb 16, 2003
posts:35
votes: 0


Nothing at my site yet (PR5). Last FreshBot was at 7AM this morning. Hopefully I'll have an hour to finish what I am working on and get it uploaded.

Paul

2:08 am on Apr 16, 2003 (gmt 0)

New User

10+ Year Member

joined:Apr 1, 2003
posts:37
votes: 0


Crawl Baby Crawl! crawl1.googlebot.com 216.239.46.6
2:25 am on Apr 16, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 31, 2003
posts:1316
votes: 0


Will it come back and double check everything. So that if I make changes now, will they register if it comes back?

It's possible. I frequently see multiple hits during the deep crawl.

2:27 am on Apr 16, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 12, 2002
posts:4479
votes: 0


No deep bot here yet, so I got that last minute change I wanted to make up in time.
2:50 am on Apr 16, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 5, 2003
posts:807
votes: 0


Normally it knocks and then comes back the next day, but so far today I've got hit 22 times on one site.
2:58 am on Apr 16, 2003 (gmt 0)

New User

10+ Year Member

joined:Feb 16, 2003
posts:35
votes: 0


I got a 216 deepbot about an hour ago on my index page, and a lot of Freshbots in the last couple hours. New changes are going up as I type from the laptop so hopefully good things will happen tonight.

Paul

3:15 am on Apr 16, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member googleguy is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Oct 8, 2001
posts:2882
votes: 0


I would definitely get your changes in soon. :)
3:23 am on Apr 16, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 12, 2002
posts:4479
votes: 0


Heh, heh. Beat you GoogleGuy. ;) The deep crawler has found my site, but not before I made the change I wanted to.
4:34 am on Apr 16, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 6, 2003
posts:79
votes: 0


Got 11 google deepbot badboys on our site right now - long with 3 Freshies, 2 Inktomi and bunch of others....
4:39 am on Apr 16, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 1, 2002
posts:774
votes: 0


Sweet!

216.239.46.55 - - [15/Apr/2003:16:18:51 -0600] "GET /robots.txt HTTP/1.0" 200 5231 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
216.239.46.55 - - [15/Apr/2003:16:18:51 -0600] "GET / HTTP/1.0" 200 17474 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

640 hits so far by 20:00 PM.

Go Girl!

dave

4:43 am on Apr 16, 2003 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member ogletree is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Apr 14, 2003
posts:4307
votes: 35


Man my server was down. What is the chance I missed this entirely. Do I have to wait another month. I was down for several hours from 4:00 CST to 7:30 CST. I guess I just look at logs.
4:47 am on Apr 16, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 5, 2003
posts:807
votes: 0


Just watch your logs during the next 10 days.

Last month I was able to add new stuff during the first few days of the deepcrawl and still get the Googlebot to deepcrawl it.

5:46 am on Apr 16, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Nov 14, 2002
posts:422
votes: 0


I'm hoping this crawl fixes a ton of problems I had with the last round. I have .com, .org, .net and .biz pointing to the same domain, which I think resulted in serious PR dilution (Pr5 and Pr6 to PR4).

Hopefully the new redirection code fixes it.

6:08 am on Apr 16, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 17, 2003
posts:172
votes: 0


>>Man my server was down. What is the chance I missed this entirely.

I'm sure Mabel will be back to see if your site is alive. (I'm trying to name the bots LOL)

Maybe GG will tell us what they call the bots...

6:58 am on Apr 16, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Aug 15, 2000
posts:482
votes: 0


wow - just a bit too early, but we managed almost all new content we needed in the index in may. So - go.
This 120 message thread spans 4 pages: 120
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members