homepage Welcome to WebmasterWorld Guest from 54.237.151.188
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

This 188 message thread spans 7 pages: 188 ( [1] 2 3 4 5 6 7 > >     
Google Sitemaps
Googlebot getting tired?
shadows2000

10+ Year Member



 
Msg#: 29740 posted 1:13 am on Jun 3, 2005 (gmt 0)

I found an interesting new service from Google called Google sitemaps (I haven't seen this mentioned elsewhere. Seems you can give Googlebot a helping hand if some pages are not getting indexed?

Seems strange that Google are introducing this service now and not try to improve googlebot when following links.

https://www.google.com/webmasters/sitemaps/

 

Dominic_X

10+ Year Member



 
Msg#: 29740 posted 3:15 am on Jun 3, 2005 (gmt 0)

Google has opened up a way to make XML feeds of site maps to make spidering more efficient.

https://www.google.com/webmasters/sitemaps/

outrun

10+ Year Member



 
Msg#: 29740 posted 8:56 am on Jun 3, 2005 (gmt 0)

https://www.google.com/webmasters/sitemaps/docs/en/about.html

[qoute]Google Sitemaps is intended for all web site owners, from those with a single web page to companies with millions of ever-changing pages.[/qoute]

[qoute]You want Google to crawl more of your web pages.
You want to be able to tell Google when content on your site changes.[/quote]

deus

10+ Year Member



 
Msg#: 29740 posted 9:11 am on Jun 3, 2005 (gmt 0)

Just discovered a new feature in Google's webmaster guidelines at [google.com...]

Google Sitemaps at https://www.google.com/webmasters/sitemaps/

Any experiences anybody?

arran

5+ Year Member



 
Msg#: 29740 posted 10:15 am on Jun 3, 2005 (gmt 0)

[google.com ]

Ozark

5+ Year Member



 
Msg#: 29740 posted 11:21 am on Jun 3, 2005 (gmt 0)

Google Sitemaps is an easy way for you to help improve your coverage in the Google index. It's a collaborative crawling system that enables you to communicate directly with Google to keep us informed of all your web pages, and when you make changes to these pages.

With Google Sitemaps you get:

* Better crawl coverage to help people find more of your web pages
* Fresher search results
* A smarter crawl because you can provide specific information about all your web pages, such as when a page was last modified or how frequently a page changes

https://www.google.com/webmasters/sitemaps/login

twinsrul

10+ Year Member



 
Msg#: 29740 posted 12:24 pm on Jun 3, 2005 (gmt 0)

Looks like Google's at it again. This looks like a free way to directly submit your entire website without the crawler actually looking through everything. For us non webmasterworld supporters, any thoughts?

StuffOfInterest

5+ Year Member



 
Msg#: 29740 posted 2:22 pm on Jun 3, 2005 (gmt 0)

https://www.google.com/webmasters/sitemaps

This could be VERY helpful for sites. Using an XML formatted file you can tell Google what pages you would like crawled, when they were last updated, and what their relative importance is to the site. There are even facilities to see when the sitemap was last picked up and processed.

If this service works, it could finally solve some big problems I've had with identifying high importance over low importance content on my site. The fun part is going to be building auto-generators so that the sitemap is updated with correct info as I update my site.

catman

5+ Year Member



 
Msg#: 29740 posted 3:49 pm on Jun 3, 2005 (gmt 0)

Are Google sitemaps something new to you guys?

Is anyone noticing an improvement in crawling or ranking as a result of using one?

Does anyone have any reservations?

[google.com...]

SimmoAka

5+ Year Member



 
Msg#: 29740 posted 7:22 pm on Jun 3, 2005 (gmt 0)

Hi all

Interested on opinions on the new XML (/text) sitemaps integration from Google. Is anyone using them yet and do you think this is likely to help improve SERPS?

I get crawled every couple of days anyway but wondered if its potentially worth setting one of the Google ones up specifically. Be interested in peoples opinions but am thinking about trying the text version for a starter, despite it being given lower priority as i understand it.

Cheers

Simmo!

StuffOfInterest

5+ Year Member



 
Msg#: 29740 posted 8:05 pm on Jun 3, 2005 (gmt 0)

Created a simple one this morning with under a dozen URLs from my site. The crawler came by later in the morning and picked up a few of the URLs. Next I need to come up with a way of generated the sitemap.xml file for all of the content rich URLs on my site. Should make for a nice evening project.

The real test will be to see how long before pages picked up through this service show up in the SERPs. This could be a very big improvement over post it and wait for the crawler to find you operations.

RS_200_gto

10+ Year Member



 
Msg#: 29740 posted 9:19 pm on Jun 3, 2005 (gmt 0)

How about our own site Sitemaps, we had a Sitemap on our site for over 15 month, and it does not show up in the SERP's.

SimmoAka

5+ Year Member



 
Msg#: 29740 posted 9:35 pm on Jun 3, 2005 (gmt 0)

Yes SoI. It will be interesting to see that. I am wondering if G will make an assumption that webmasters who make the effort to do this deserve some SERPS priority. Or whether it is in fact a tool aimed at identifying spam/scrapers in some way.

Might give it a try myself.

Romeo

10+ Year Member



 
Msg#: 29740 posted 9:47 pm on Jun 3, 2005 (gmt 0)

Or whether it is in fact a tool aimed at identifying spam/scrapers in some way.

I doubt that this is behind the sitemaps.
A lot of private small sites have no capabilities of running python scripts at a shell prompt or even know about.

Just tried and submitted for one of my sites and watching the logs now what will happen then ...

Google first says something about
# Better crawl coverage
# Fresher search results
# A smarter crawl
on one page and later says
# Please note that we do not add all submitted URLs to our index, and we cannot make any predictions or guarantees about when or if they will appear.

Lets see ...

Regards,
R.

chopin2256

5+ Year Member



 
Msg#: 29740 posted 9:56 pm on Jun 3, 2005 (gmt 0)

Whats a google sitemap?

bobothecat



 
Msg#: 29740 posted 9:57 pm on Jun 3, 2005 (gmt 0)

Google Sitemaps
Anyone using them yet?

Looked at the info... don't think I'll touch this one with a ten-foot pole.

'Something doesn't sound right' ... Just my opinion. :)

Billy Batson

5+ Year Member



 
Msg#: 29740 posted 10:01 pm on Jun 3, 2005 (gmt 0)

I was one of the webmasters hit by the latest algo update (lost about 90% of our Google traffic) on a 6 year old content rich site. (PR 6)

I have run the sitemap program and it's identified 57823 pages on my site, which seems accurate.

I'm going to set up a cron and have it run once and hour, since it doesn't seem to put any undue load on the server. We add about 20 to 30 new pages of content per day, so hopefully it'll speed up how soon those pages get indexed.

I'm still concerned about the effects of Bourbon, but hoping (as is my wife and bank manager) that this will normalize the SERPs for my site.

lorenzinho2

10+ Year Member



 
Msg#: 29740 posted 10:06 pm on Jun 3, 2005 (gmt 0)

My understanding is that the those that were invited to trial this program are under NDA not to discuss details, so I'm not sure how much will be forthcoming.

vincevincevince

WebmasterWorld Senior Member vincevincevince us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 29740 posted 10:06 pm on Jun 3, 2005 (gmt 0)

I have some reservations in terms of creating my own sitemap file. I'm terrified that if I miss pages then those pages won't be indexed at all (whereas now they may well be indexed by normal crawl behaviour).

my wife and bank manager

I can't decide whether that was humerously implying that they are one and the same.

Chndru

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 29740 posted 10:09 pm on Jun 3, 2005 (gmt 0)

What is Google Sitemap:

https://www.google.com/webmasters/sitemaps/docs/en/faq.html

bobothecat



 
Msg#: 29740 posted 10:14 pm on Jun 3, 2005 (gmt 0)

7. Will participating in this program change my pages' ranking in Google search results?

No. Using Google Sitemaps will not influence your PageRank; there will be no change in how we calculate the ranking of your pages.

Just noticed this... interesting how they use PageRank and "page's ranking" in the same statement.

Perhaps I'm just analyzing the FAQ to much :) I think most of us agree that PageRank has nothing to do with a page's rank - in most cases ( at least for now ).

Billy Batson

5+ Year Member



 
Msg#: 29740 posted 10:27 pm on Jun 3, 2005 (gmt 0)

Vince, I used the python script that Google provides to do the indexing, and as far as I can tell it was extremely thorough.

As for my wife and bank manager being one and the same... not true. But it might be handy in some instances.

Billy Batson

5+ Year Member



 
Msg#: 29740 posted 11:48 pm on Jun 3, 2005 (gmt 0)

I submitted my sitemap to google and it's now been approved.

Just have to sit here and wait and cross my fingers that once Bourbon is complete things will get back to normal for my site.

Undead Hunter

10+ Year Member



 
Msg#: 29740 posted 4:06 am on Jun 4, 2005 (gmt 0)

Actually, if you read the Privacy Policy on Google services, it says none of them are "for commercial use". That doesn't make a whole lot of sense, as they specifically mention that Sitemaps could be used for "company sites with many dynamic pages".

But I wrote them just to be 100% clear on it. No response yet.

It's in beta stage, so yes, we'll try if we're cleared to. It won't do anything to improve our after Bourbon position, I'm sure, but hopefully some new pages will get picked up faster. Same for new sites, I hope it picks these up faster too.

cayleyv

10+ Year Member



 
Msg#: 29740 posted 4:36 am on Jun 4, 2005 (gmt 0)

this makes perfect sense to me. Sounds just like the Yahoo system, except this is not pay for placement. So many websites have unindexable content, unnecessary duplicated pages, pages obscured with session ID's etc. I believe Google will use this tool to help eliminate duplicate content and maintain fresher results (ie with news and current events).

Google wont take webmaster's feeds as gospel truth however, pages will still need to be found through normal linking structure. Otherwise massive manipulation would occur, with unscrupulous webmasters generating massive unusable content in the hopes of getting rankings.

The major downside is it requires python. Hopefully PHP and the other popular scripting languages are not far behind.

i think this has promise.

lovethecoast

10+ Year Member



 
Msg#: 29740 posted 4:49 am on Jun 4, 2005 (gmt 0)

The major downside is it requires python. Hopefully PHP and the other popular scripting languages are not far behind.

I wrote an app in VB in about 20 minutes to parse my log files and bam -- instant site map. I based priority off how many backlinks there were.

Took longer to parse a month's worth of logs than it took to write the parser.

S

BigDave

WebmasterWorld Senior Member bigdave us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 29740 posted 4:22 pm on Jun 4, 2005 (gmt 0)

The major downside is it requires python. Hopefully PHP and the other popular scripting languages are not far behind.

Can you make a simple text based list of every URL on your site that you want crawled? That works just as well.

I'm going to be automating mine over the next week, so that when something changes, so does the sitemap, but for now I just change my froogle feed generator slightly to also make an URL list.

sirkei

10+ Year Member



 
Msg#: 29740 posted 4:51 pm on Jun 4, 2005 (gmt 0)

Sitemap Generator requires Python 2.2 or higher.

So i guess i cant install this. My host only provides Python 1.5.2 version. Is python 2.2 the latest or what?

Maybe i should contact my host to install python 2.2.

linux

5+ Year Member



 
Msg#: 29740 posted 6:39 pm on Jun 4, 2005 (gmt 0)

at google sitemap group is a little php script

easy to use.

the python tool from google is very well 100.000 url in 2 xml files no errors. now i wait for Python-urllib/1.15 or googlebot.

if you have a root server it is easy to upgrade, if you have a virtuell server the hoster has to do ist.

linux

mrMister

WebmasterWorld Senior Member 5+ Year Member



 
Msg#: 29740 posted 1:06 am on Jun 5, 2005 (gmt 0)

I get the feeling that the only people who will benefit from the Google sitemaps are Google themselves.

The page priority setting might be useful in some circumstances. If you have two or more pages listed on the same page of the SERPS, you should be able to use the page priority to list the better one, However I find that Google seems to list the right one on all my sites.

Using the Google Sitemaps will mean that more of your pages get indexed, but I can't see that doing much good. Any pages that aren't indexed won't rank high because they won't have enough Link Popularity (Page Rank, trust rank, or whatever Google uses these days).

Google on the other hand benefit, because they'll use up less bandwidth (they'll be able to crawl pages less frequently). Also their index size will increase quite substatially, which'll come in handy next time they want to get a bit of news coverage.

Having said all that, I'm writing an ASP.Net Control as we speak to generate a Google Sitemap for some of my sites to see what happens :-)

This 188 message thread spans 7 pages: 188 ( [1] 2 3 4 5 6 7 > >
Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved