homepage Welcome to WebmasterWorld Guest from 54.227.215.140
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

This 53 message thread spans 2 pages: < < 53 ( 1 [2]     
Anyone seen googlebot in the last 10 hours?
I got lots of sites but, no sign of googlebot? is it just me?
teeceo

10+ Year Member



 
Msg#: 9015 posted 9:25 am on Feb 3, 2003 (gmt 0)

I haven't seen googlebot for like 10 hours and I have over 30 sites, most of witch get spidered eceryday. Is it just me?

teeceo.

 

quotations

10+ Year Member



 
Msg#: 9015 posted 7:35 pm on Feb 4, 2003 (gmt 0)

>This is true, but you can also open your log files in Excel as a tab deliminated file which will allow you to sort them by what ever you're looking for.

If your log files are too big for Excel then you can import them into a database. I ususally change the extension on the log file to .txt and then open MS Access and do

File; Get External Data; Import; then change the type to Text Files and import and parse the log file.

You can filter on field 10 containing googlebot or set up queries for whatever else you want to check for.

seindal

10+ Year Member



 
Msg#: 9015 posted 8:21 pm on Feb 4, 2003 (gmt 0)

I'm getting some hits from the freshbot.
It's a PR5 site.

hskfun

10+ Year Member



 
Msg#: 9015 posted 9:03 pm on Feb 4, 2003 (gmt 0)

Still just freshbot here.
Patiently waiting...

Skier

10+ Year Member



 
Msg#: 9015 posted 9:29 pm on Feb 4, 2003 (gmt 0)

Freshbot was last by on Feb 03. Not one googlebot visit on Feb 04 - yet. Strangely quiet isn't it?

Just as well, AOL's bots have been feeding in large herds - not much room left for anyboty else here.

Night_Hawk

10+ Year Member



 
Msg#: 9015 posted 9:46 pm on Feb 4, 2003 (gmt 0)

Both Googlebot and freshbot still MIA here.
Do you think they are getting old and tired? or just on vacation?

pontifex

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 9015 posted 10:24 pm on Feb 4, 2003 (gmt 0)

I guess its starting now... we getting serveral hits per minute since 15 minutes ago...

Stefan

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 9015 posted 10:40 pm on Feb 4, 2003 (gmt 0)

I have 64.68.82.xx bots coming through at the moment but they do that often. No deepbot yet. Ink and Fast have been keeping pretty busy here, and various bizarro-bots like teradex.

It's been a week hasn't it since the last update finished? It really seems late for the deepcrawl.

amznVibe

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 9015 posted 10:55 pm on Feb 4, 2003 (gmt 0)

crawler09 10 and 11 on one site an hour ago...
any idea why they would read the same page more than once? kinda strange...

Stefan

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 9015 posted 11:02 pm on Feb 4, 2003 (gmt 0)

I've been seeing that over the last week with the freshbot, amznVibe. It's been taking the PR6 pages, index.htm and main.htm, twice in a row. I have no idea why...

Night_Hawk

10+ Year Member



 
Msg#: 9015 posted 4:32 am on Feb 5, 2003 (gmt 0)

That's more like it.
I guess vacation is over, Googlebot has benn working very hard late today in my site.

seindal

10+ Year Member



 
Msg#: 9015 posted 6:23 am on Feb 5, 2003 (gmt 0)

Same thing here.

getvisibleuk

10+ Year Member



 
Msg#: 9015 posted 8:03 am on Feb 5, 2003 (gmt 0)

she's going mad! :-)

KakenBetaal

10+ Year Member



 
Msg#: 9015 posted 9:10 am on Feb 5, 2003 (gmt 0)

Yes, but still no deepcrawler anywhere!

taxpod

10+ Year Member



 
Msg#: 9015 posted 11:17 am on Feb 5, 2003 (gmt 0)

Same here - no deepcrawler. Seems kind of late this month.

hetzeld

10+ Year Member



 
Msg#: 9015 posted 11:45 am on Feb 5, 2003 (gmt 0)

Same here, about 50 hits from the FreshBots since midnight on my main PR6 site (1000 pages)

Same on another site (no PR yet - online since january 13 - never been deepcrawled) 80 pages content and 60 hits from FreshBots.

Same on a PR4 site (40 hits)

Dan

Stefan

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 9015 posted 2:42 pm on Feb 5, 2003 (gmt 0)

Freshie was very busy overnight but I still haven't seen a deepbot.

Jesse_Smith

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 9015 posted 8:29 pm on Feb 5, 2003 (gmt 0)

When does the deepcrawler <216.239.46.*> come? I always hurd that it was in about the middle of the month.

Slud

10+ Year Member



 
Msg#: 9015 posted 9:13 pm on Feb 5, 2003 (gmt 0)

I've got the Googlebot going absolutely bizerk downloading robots.txt 100+ times PER SITE.

Stefan

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 9015 posted 9:25 pm on Feb 5, 2003 (gmt 0)

Hi Jesse, welcome to Webmasterworld.

The last two crawls it seemed to start within a few days of the end of the update. It appears to be late this time. Only Google Guy really knows when to expect it next.

yankee

10+ Year Member



 
Msg#: 9015 posted 1:21 am on Feb 6, 2003 (gmt 0)

Red Alert!
Deep crawl bot is alive!

mfishy

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 9015 posted 1:24 am on Feb 6, 2003 (gmt 0)

Yes, my sites were all hit about 5:00 by the deepcrawler.

spam90



 
Msg#: 9015 posted 1:25 am on Feb 6, 2003 (gmt 0)

I'm being deep crawled right now by numerous 216.239.46.* IP's.

Well, my web site is anyway.

KakenBetaal

10+ Year Member



 
Msg#: 9015 posted 7:46 am on Feb 6, 2003 (gmt 0)

Yup, deepcrawler is on my site (PR5 index). Finally!

This 53 message thread spans 2 pages: < < 53 ( 1 [2]
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved