Welcome to WebmasterWorld Guest from 54.196.233.239

Message Too Old, No Replies

Crawl Stats, Graphs and Settings in WMT

     

g1smd

7:13 pm on Jun 26, 2008 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month




I've always thought that the three little graphs of how many pages Google has accessed on the site, the time taken, and the amount of data transferred, were in the wrong place in WMT.

They were under Tools --> Set Crawl Rate (or was it called Crawl Stats?), and that was the place where you could also tell Google to slow down on crawling your site.

The graphs have now been split off into their own "Crawl Stats" section under Statistics, leaving the other related settings in the original "Set Crawl Rate" option under Tools.

Much better!

The graphs also have a new format, and the data seems slightly better presented.

.

Not sure if it was a bug, but back when the website I was working on at the time only had one page, Google WMT reported anything from zero to four pages per day being crawled in those graphs. I didn't have access to the site logs to see if it was simply Google taking the same page multiple times per day, or not. Have other people seen that effect?

g1smd

8:01 pm on Jun 26, 2008 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Another improvement.

There are now division lines between each month on the graph. This makes it easier to guess the dates for each point on the graph to within a day or so either way.

I'm not so sure that the PageRank information should be on the same page as the Crawl Stats (it is currently under those Crawl Stats graphs). Maybe the PageRank information should have it's own page?

g1smd

12:50 pm on Jun 27, 2008 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



It looks like the Content Analysis section gets updated data imported every day now (it appeared that it used to be only weekly or so). It also now has a "last updated" date on that screen.

.

However, I have just gone from having several minor problems listed, to having none, so it might just be that today's date is printed on screen for the reports when there is nothing to report.

It would be interesting to see if the date appears, and how often it changes, for a site that does have problems to report.

g1smd

2:36 am on Jul 8, 2008 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Graphs updated sometime in the last few hours to show data from the first week of July.

BillyS

2:46 am on Jul 8, 2008 (gmt 0)

WebmasterWorld Senior Member billys is a WebmasterWorld Top Contributor of All Time 10+ Year Member



A number of interesting updates, including the ability to use a feed as a sitemap.

g1smd

10:20 am on Jul 8, 2008 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



I missed that one. I don't use XML or text sitemaps though.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month