Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Google Sitemaps - Updated

With new information about crawl, index, pagerank

         

skyhawk133

7:58 pm on Nov 16, 2005 (gmt 0)

10+ Year Member



I just logged in to my Google Sitemaps ([google.com ]) and noticed they made some updates in the past hour or 2.

Noticeably, the interface is a little different. Sitemaps are now listed as "See stats for: yourdomain.com" Clicking this link shows several new stats (used to only show the crawl stats)

Now you are presented with this:

Query stats ¦ Crawl stats ¦ Page analysis ¦ Index stats

Here are the descriptions:


Query Stats:
Top search queries are the top queries to Google that return pages from your site. Top search query clicks are the top queries to Google that directed traffic to your site (based on the number of clicks to your pages in our search results).

Crawl Stats:
These statistics provide distribution information for pages we have crawled. [This page also shows page rank distribution across all pages crawled.]


Page Analysis:
These statistics show you how the Googlebot sees your site.


Index Stats:
You can use our Advanced Search page to find out how your site is indexed. Below, we've done some of these searches for you. [Just quick links to site:domain.com, etc.]

I like the information being provided on query stats the most, it's only a little glimpse, but lets you know what keyword you are showing up most for.

There is also a new "Errors" tab that has the following info:

HTTP errors ¦ Unreachable URLs ¦ URLs restricted by robots.txt ¦ URLs not followed ¦ URLs timed out

In order to use any of the advanced statistics, you must verify your domain. Information on stats and verifying can be found here [google.com]

linkjack

8:45 pm on Nov 17, 2005 (gmt 0)



Sounds like a lure to attract more people to using sitemaps?

I wouldn't say so.

Looks to me like they're trying to get more people not to use sitemaps.

You see Google made an important discovery: people are like sheep!

Give them bread and circus and they'll provide free feedback, free sitemaps to ease their job, free content to fill their engine.

What the heck, people will even provide their credit card numbers on adwords, or, better still, their full personal profile and relationships on Orkut!

Isn't this awesome! Let's join this now and make Google's life even easier! Alright!

linkjack

8:48 pm on Nov 17, 2005 (gmt 0)



... because it tells google who owns what domain (better than WHOIS data ever could) and therefore who is cross-linking all their sites, so that they can take this into account when assigning values to links...

Nah...Google wouldn't do that. They're our buddies!

Demaestro

8:51 pm on Nov 17, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



RE:Does anyone know if the results are better if you do have a Google sitemap?

I have found that it is more efficient when crawling my site, things that I defined as having a change frequency of 'always' seem to receive a lot more hits from googlebot, the ones I defined as monthly have almost no hits. Also it never indexed my Forum boards before and it nows seems to be no problem. I hate to say this is all because of my G sitemap submission but that seems opimistic for one tool. It is likely that an agorythom has changed, but I have seen increased traffic to my site which is a very niche site. I would say for sure though that the saving on bandwidth
(if you have enough sites this would be reason enough to use it). It seems to respect the frequecy tag and the last modified tag and indexes your site accordingly.

Also my firend's new site was totally sandboxed, new URL, no sites pointing to it. I suggested Google sitemaps and he has recieved about 500 googlebot hits mentioned in his logs this month so it seems to make a difference.

Another thing, does anyone notice that some of the new data that they giving in G sitemaps is more related to the new Urchin thingy, Google Analytics then Sitemap? Just wondering if this is a prelude to to them saying, Want more data? Sign up here for Google Analytics.

ronburk

1:04 am on Nov 18, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hmmm, my "top search queries" shows the exact same term in positions 1, 3, and 5. Wonder what that means...

Ankhenaton

2:01 am on Nov 18, 2005 (gmt 0)



I quite like sitemaps as you have at least some low level form of communication with the bot. :)

otc_cmnn

2:31 am on Nov 18, 2005 (gmt 0)

10+ Year Member



I honestly think this is the best effort in a while regarding engines reaching out to webmasters. Allowing us to see where they are having trouble with their crawls in our sites is a real help. Sure kicks Y!'s Site Exporers butt!

Of course they are going to use this information for the greater good, and if you are stupid enough to sitemap all of your Splogs with the same google account then you deserve what you get.

'Google is the new Big Brother' says the tinfoil hat wearing nerd as he peeks out from his moms basement... No sh*t! Get used to it and act accordingly, Google provides GREAT traffic for free, GREAT email and many many other great services FREE! AND is actually reaching out to the webmasters! If you are a light grey hat or better then you have nothing to fear. If you live an honest life and have nothing to hide, fear not.

Otherwise, cover your tracks!

I think Google deserve's an award for this one (even though it is broken and the Query stats repeat phrases, but i sure they are 'working' on it)

DaveN

3:34 pm on Nov 18, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



try adding aol.com to your account lol

DaveN

Joern_Malek

11:58 pm on Nov 18, 2005 (gmt 0)

10+ Year Member



Hi,
I have 20 oldfashioned sitemaps (with up to 100 links per map)on our country portal (38,000 pages) these sitemaps list the most important pages and I keep them as updated and lean as possible. Google bots visit us every day. Some tell me, that they should have anker-text and body. So far I stayed away from all that.

When Google Site maps announced themselves I thought that is a lot of extra work and serves only Google. What about all the other search engines? They produce 40% of our search engine traffic or about 15% of our overall traffic.

I would like to hear some comments about the pros and cons, before I tackle the project to put Google Site maps on the site. Any help out there?

Have a happy day
Jörn

danny

12:34 pm on Nov 20, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Has anyone got any "High" PageRank pages? I have half a dozen or so PR 7 pages, but they seem to be "Medium", like the rest of my pages. So I'm thinking it must be

Low: PR 1-4
Medium: PR 5-7
High: PR 8-10

Which doesn't seem the most useful division for most people.

vitaplease

1:12 pm on Nov 20, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Same here Danny, on the Pagerank distribution.

I think they should redo that to a bit less ambitious and more realistic levels.
Who knows it now might encourage more Pageranked buying of links? :)

Having more "query stats" would also help, as would not showing duplicates. Certainly if the site has rather high traffic on many different pages.

This 40 message thread spans 2 pages: 40