homepage Welcome to WebmasterWorld Guest from 50.16.112.199
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

    
G Deep Crawling?
Nick_W

WebmasterWorld Senior Member nick_w us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 17338 posted 5:45 am on Oct 1, 2003 (gmt 0)

Noticed that during the night instead of pecking off a few pages as his the daily habbit Gbot picked up a few K's worth on some sites...

Nick

 

Jesse_Smith

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 17338 posted 5:08 pm on Oct 1, 2003 (gmt 0)

I've been geting deepcrawled daily for over a month.

plasma

10+ Year Member



 
Msg#: 17338 posted 5:12 pm on Oct 1, 2003 (gmt 0)

I have deep crawls daily ;)

wkitty42

10+ Year Member



 
Msg#: 17338 posted 10:32 pm on Oct 1, 2003 (gmt 0)

i don't know that i can tell one from the other... over night, google has been all over my site... last week, it was google, inktomi, scooter, zyborg and a few others... i seem to have more bots visiting than users ;)

dpplgngr

10+ Year Member



 
Msg#: 17338 posted 10:34 pm on Oct 1, 2003 (gmt 0)

awstats will report the different bots with decent precision.

if you want to go crazy with precision, get the fantom bot list...

Ally_Cat

10+ Year Member



 
Msg#: 17338 posted 10:50 pm on Oct 1, 2003 (gmt 0)

Google has been crawling us like crazy since Saturday. *shrug*

CCowboy

10+ Year Member



 
Msg#: 17338 posted 5:13 am on Oct 2, 2003 (gmt 0)

Saw the liitle guy go deep and long today!

truth_speak

10+ Year Member



 
Msg#: 17338 posted 6:00 am on Oct 2, 2003 (gmt 0)

Usually 20 pages a day for the GBot, but last night it was double--41 pages.

Dayo_UK

10+ Year Member



 
Msg#: 17338 posted 10:53 am on Oct 2, 2003 (gmt 0)

Agreed this looks more like a deepcrawl.

100 odd pages taken yesterday, another 80 odd today - and different pages too :)

I am used to having the same 100 pages crawled every few days, but today it is picking up deep new pages.

creative craig

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 17338 posted 11:18 am on Oct 2, 2003 (gmt 0)

Been deepcrawling for two days now on a few sites.

killroy

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 17338 posted 11:40 am on Oct 2, 2003 (gmt 0)

Hmm between 500 and 6000 pages per day... 2000 on tuesday and hardly anything yesterday... and all of my home computer, ouch. Makes me lag sometimes...

SN

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved