Welcome to WebmasterWorld Guest from 54.146.194.42

Message Too Old, No Replies

Are blocked URLs reported in WMT affecting average page load speed?

     
7:18 pm on Jul 18, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member bwnbwn is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Oct 25, 2005
posts:3492
votes: 3


Does anybody else have a url in the site speed area in your webmaster tools section that Google uses as an example of the page load speed that is blocled by robots.txt.

Google is showing a url to my cart cgi/bin that I have blocked in robots.txt as an example of the page load speed.

This leads me to wonder are these urls being used to establish my site page load speed average.
9:16 pm on July 18, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member aristotle is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Aug 4, 2008
posts:2681
votes: 94


As I understand it, if people visit a page, then its load speed is included in the overall site speed calculation, weighted according to have often it is visited. This is true even if robots.txt blocks Googlebot and other spiders from crawling the page.
10:52 pm on July 18, 2010 (gmt 0)

Preferred Member

10+ Year Member

joined:Dec 12, 2004
posts:608
votes: 1


Yes, the suggestions and example sections includes pages that are blocked with robots.txt.
1:41 am on July 20, 2010 (gmt 0)

Junior Member

5+ Year Member

joined:Aug 30, 2007
posts:90
votes: 0


Yes, Google is using my stats page which is the longest loading page on my site (13s) and it is only I who have access to it. The vast majority of my pages load in about 1 sec and Google reports an average of 2.3sec for the site.

I couldn't say for sure whether it is being included in the calculation or not as my home page is very long and takes about 4 or 5 seconds to load.