Welcome to WebmasterWorld Guest from

Message Too Old, No Replies

Are blocked URLs reported in WMT affecting average page load speed?



7:18 pm on Jul 18, 2010 (gmt 0)

WebmasterWorld Senior Member bwnbwn is a WebmasterWorld Top Contributor of All Time 5+ Year Member

Does anybody else have a url in the site speed area in your webmaster tools section that Google uses as an example of the page load speed that is blocled by robots.txt.

Google is showing a url to my cart cgi/bin that I have blocked in robots.txt as an example of the page load speed.

This leads me to wonder are these urls being used to establish my site page load speed average.


9:16 pm on Jul 18, 2010 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member Top Contributors Of The Month

As I understand it, if people visit a page, then its load speed is included in the overall site speed calculation, weighted according to have often it is visited. This is true even if robots.txt blocks Googlebot and other spiders from crawling the page.


10:52 pm on Jul 18, 2010 (gmt 0)

10+ Year Member

Yes, the suggestions and example sections includes pages that are blocked with robots.txt.


1:41 am on Jul 20, 2010 (gmt 0)

5+ Year Member

Yes, Google is using my stats page which is the longest loading page on my site (13s) and it is only I who have access to it. The vast majority of my pages load in about 1 sec and Google reports an average of 2.3sec for the site.

I couldn't say for sure whether it is being included in the calculation or not as my home page is very long and takes about 4 or 5 seconds to load.