homepage Welcome to WebmasterWorld Guest from 184.73.27.20
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

This 120 message thread spans 4 pages: 120 ( [1] 2 3 4 > >     
Deepbot is in the house....
I just seen deepbot on my server all
teeceo




msg:47528
 10:30 pm on Apr 15, 2003 (gmt 0)

Its deepbot time!

teeceo.

 

marcs




msg:47529
 10:30 pm on Apr 15, 2003 (gmt 0)

It is. Just posted some log entries in another thread. It just started.

vincevincevince




msg:47530
 10:32 pm on Apr 15, 2003 (gmt 0)

<cries> It's too early! I need time to fix the troubles I just found from the last update </cries>

teeceo




msg:47531
 10:35 pm on Apr 15, 2003 (gmt 0)

Its true.

teeceo.

216.239.46.206 - - [15/Apr/2003:15:16:55 -0700] "GET /robots.txt HTTP/1.0" 404 - "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

Abuzer




msg:47532
 10:36 pm on Apr 15, 2003 (gmt 0)

Yeah deep is just started on my site too..

BGumble




msg:47533
 10:40 pm on Apr 15, 2003 (gmt 0)

Hello Mr. Deep, cmon in. Here too, good thing I'm done!

pendanticist




msg:47534
 10:41 pm on Apr 15, 2003 (gmt 0)

216.239.46.78

crawl3.googlebot.com - - [15/Apr/2003:15:26:57 -0700] "GET /robots.txt HTTP/1.0" 200 220 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

Ok. Works for me.

Pendanticist.

Jacob_Jans




msg:47535
 11:29 pm on Apr 15, 2003 (gmt 0)

216.* is on my site also. Will it come back and double check everything. So that if I make changes now, will they register if it comes back?

PaulPaul




msg:47536
 11:36 pm on Apr 15, 2003 (gmt 0)

Please come visit me you sexy lil deepcrawler you..

bether2




msg:47537
 11:38 pm on Apr 15, 2003 (gmt 0)

Deepbot is on my site too. Just started within past hour. (PR6 site)

ircgeeks




msg:47538
 12:03 am on Apr 16, 2003 (gmt 0)

/me lays out the milk and cookies come and get um deep! Crawl it baby! My bandwidth for you!

BGumble




msg:47539
 12:17 am on Apr 16, 2003 (gmt 0)

>>Will it come back and double check everything.

Wouldn't that mean reading the entire web in twice? Doesn't make sense on their part. I was wondering if Deepbot took Freshbot's updates before compiling the cycle but couldn't find the info with the search..

Jon_King




msg:47540
 12:30 am on Apr 16, 2003 (gmt 0)

Just like Gollum....

Stefan




msg:47541
 12:33 am on Apr 16, 2003 (gmt 0)

2003-04-15 23:14:29 216.239.46.104

Right on schedule...

bunltd




msg:47542
 1:07 am on Apr 16, 2003 (gmt 0)

Showed up here too, just a while ago. Better finish what I'm doing :)

paulewing




msg:47543
 1:45 am on Apr 16, 2003 (gmt 0)

Nothing at my site yet (PR5). Last FreshBot was at 7AM this morning. Hopefully I'll have an hour to finish what I am working on and get it uploaded.

Paul

ircgeeks




msg:47544
 2:08 am on Apr 16, 2003 (gmt 0)

Crawl Baby Crawl! crawl1.googlebot.com 216.239.46.6

mcavic




msg:47545
 2:25 am on Apr 16, 2003 (gmt 0)

Will it come back and double check everything. So that if I make changes now, will they register if it comes back?

It's possible. I frequently see multiple hits during the deep crawl.

rfgdxm1




msg:47546
 2:27 am on Apr 16, 2003 (gmt 0)

No deep bot here yet, so I got that last minute change I wanted to make up in time.

Jesse_Smith




msg:47547
 2:50 am on Apr 16, 2003 (gmt 0)

Normally it knocks and then comes back the next day, but so far today I've got hit 22 times on one site.

paulewing




msg:47548
 2:58 am on Apr 16, 2003 (gmt 0)

I got a 216 deepbot about an hour ago on my index page, and a lot of Freshbots in the last couple hours. New changes are going up as I type from the laptop so hopefully good things will happen tonight.

Paul

GoogleGuy




msg:47549
 3:15 am on Apr 16, 2003 (gmt 0)

I would definitely get your changes in soon. :)

rfgdxm1




msg:47550
 3:23 am on Apr 16, 2003 (gmt 0)

Heh, heh. Beat you GoogleGuy. ;) The deep crawler has found my site, but not before I made the change I wanted to.

NexDog




msg:47551
 4:34 am on Apr 16, 2003 (gmt 0)

Got 11 google deepbot badboys on our site right now - long with 3 Freshies, 2 Inktomi and bunch of others....

carfac




msg:47552
 4:39 am on Apr 16, 2003 (gmt 0)

Sweet!

216.239.46.55 - - [15/Apr/2003:16:18:51 -0600] "GET /robots.txt HTTP/1.0" 200 5231 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"
216.239.46.55 - - [15/Apr/2003:16:18:51 -0600] "GET / HTTP/1.0" 200 17474 "-" "Googlebot/2.1 (+http://www.googlebot.com/bot.html)"

640 hits so far by 20:00 PM.

Go Girl!

dave

ogletree




msg:47553
 4:43 am on Apr 16, 2003 (gmt 0)

Man my server was down. What is the chance I missed this entirely. Do I have to wait another month. I was down for several hours from 4:00 CST to 7:30 CST. I guess I just look at logs.

Jesse_Smith




msg:47554
 4:47 am on Apr 16, 2003 (gmt 0)

Just watch your logs during the next 10 days.

Last month I was able to add new stuff during the first few days of the deepcrawl and still get the Googlebot to deepcrawl it.

shrirch




msg:47555
 5:46 am on Apr 16, 2003 (gmt 0)

I'm hoping this crawl fixes a ton of problems I had with the last round. I have .com, .org, .net and .biz pointing to the same domain, which I think resulted in serious PR dilution (Pr5 and Pr6 to PR4).

Hopefully the new redirection code fixes it.

BGumble




msg:47556
 6:08 am on Apr 16, 2003 (gmt 0)

>>Man my server was down. What is the chance I missed this entirely.

I'm sure Mabel will be back to see if your site is alive. (I'm trying to name the bots LOL)

Maybe GG will tell us what they call the bots...

oLeon




msg:47557
 6:58 am on Apr 16, 2003 (gmt 0)

wow - just a bit too early, but we managed almost all new content we needed in the index in may. So - go.

This 120 message thread spans 4 pages: 120 ( [1] 2 3 4 > >
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved