| 7:35 pm on Feb 4, 2003 (gmt 0)|
>This is true, but you can also open your log files in Excel as a tab deliminated file which will allow you to sort them by what ever you're looking for.
If your log files are too big for Excel then you can import them into a database. I ususally change the extension on the log file to .txt and then open MS Access and do
File; Get External Data; Import; then change the type to Text Files and import and parse the log file.
You can filter on field 10 containing googlebot or set up queries for whatever else you want to check for.
| 8:21 pm on Feb 4, 2003 (gmt 0)|
I'm getting some hits from the freshbot.
It's a PR5 site.
| 9:03 pm on Feb 4, 2003 (gmt 0)|
Still just freshbot here.
| 9:29 pm on Feb 4, 2003 (gmt 0)|
Freshbot was last by on Feb 03. Not one googlebot visit on Feb 04 - yet. Strangely quiet isn't it?
Just as well, AOL's bots have been feeding in large herds - not much room left for anyboty else here.
| 9:46 pm on Feb 4, 2003 (gmt 0)|
Both Googlebot and freshbot still MIA here.
Do you think they are getting old and tired? or just on vacation?
| 10:24 pm on Feb 4, 2003 (gmt 0)|
I guess its starting now... we getting serveral hits per minute since 15 minutes ago...
| 10:40 pm on Feb 4, 2003 (gmt 0)|
I have 64.68.82.xx bots coming through at the moment but they do that often. No deepbot yet. Ink and Fast have been keeping pretty busy here, and various bizarro-bots like teradex.
It's been a week hasn't it since the last update finished? It really seems late for the deepcrawl.
| 10:55 pm on Feb 4, 2003 (gmt 0)|
crawler09 10 and 11 on one site an hour ago...
any idea why they would read the same page more than once? kinda strange...
| 11:02 pm on Feb 4, 2003 (gmt 0)|
I've been seeing that over the last week with the freshbot, amznVibe. It's been taking the PR6 pages, index.htm and main.htm, twice in a row. I have no idea why...
| 4:32 am on Feb 5, 2003 (gmt 0)|
That's more like it.
I guess vacation is over, Googlebot has benn working very hard late today in my site.
| 6:23 am on Feb 5, 2003 (gmt 0)|
Same thing here.
| 8:03 am on Feb 5, 2003 (gmt 0)|
she's going mad! :-)
| 9:10 am on Feb 5, 2003 (gmt 0)|
Yes, but still no deepcrawler anywhere!
| 11:17 am on Feb 5, 2003 (gmt 0)|
Same here - no deepcrawler. Seems kind of late this month.
| 11:45 am on Feb 5, 2003 (gmt 0)|
Same here, about 50 hits from the FreshBots since midnight on my main PR6 site (1000 pages)
Same on another site (no PR yet - online since january 13 - never been deepcrawled) 80 pages content and 60 hits from FreshBots.
Same on a PR4 site (40 hits)
| 2:42 pm on Feb 5, 2003 (gmt 0)|
Freshie was very busy overnight but I still haven't seen a deepbot.
| 8:29 pm on Feb 5, 2003 (gmt 0)|
When does the deepcrawler <216.239.46.*> come? I always hurd that it was in about the middle of the month.
| 9:13 pm on Feb 5, 2003 (gmt 0)|
I've got the Googlebot going absolutely bizerk downloading robots.txt 100+ times PER SITE.
| 9:25 pm on Feb 5, 2003 (gmt 0)|
Hi Jesse, welcome to Webmasterworld.
The last two crawls it seemed to start within a few days of the end of the update. It appears to be late this time. Only Google Guy really knows when to expect it next.
| 1:21 am on Feb 6, 2003 (gmt 0)|
Deep crawl bot is alive!
| 1:24 am on Feb 6, 2003 (gmt 0)|
Yes, my sites were all hit about 5:00 by the deepcrawler.
| 1:25 am on Feb 6, 2003 (gmt 0)|
I'm being deep crawled right now by numerous 216.239.46.* IP's.
Well, my web site is anyway.
| 7:46 am on Feb 6, 2003 (gmt 0)|
Yup, deepcrawler is on my site (PR5 index). Finally!
| This 53 message thread spans 2 pages: < < 53 ( 1  ) |