homepage Welcome to WebmasterWorld Guest from 54.211.219.178
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
Difference between Google indexed and search results
Have only 2 pages indexed by Google, but 125 K+ in search results
chicora




msg:728144
 11:40 pm on Jun 17, 2005 (gmt 0)

Hi - I apologize if this is considered a stupid question. I have a large health site and if I type in the name of the site inside quotation marks, more than 125,000 results appear. I know they are all related to my site because the name is quite distinct.

But when I search to see how many pages have been indexed by google - site:www.(site name).com it only shows 2 pages!

Looking at Googles explanation of why it may have not indexed pages [google.com...] it mentions a few reasons like dynamic pages etc.. Now most of our pages are dynamic, though they don't contain a "?" in the url. Is this the probable reason for the low number of indexed pages?

Is it bad to have so few indexed pages, or should I be more concerned about the large number of "hits" that Google shows for the site name? I did try adding Google's site search option but it was a dismal failure - I suppose due to the fact that it hasn't indexed any pages on the site.

Any feedback would be greatly appreciated!

 

tedster




msg:728145
 3:01 am on Jul 3, 2005 (gmt 0)

Yes, there's a big difference between pages that talk ABOUT your site, and pages that are actually urls FROM your site. If the site: operator only returns 2 results out of a possible 125,000 I'd say it's definitely time to take a look at your links for any reason that Googlebot may have trouble crawling deeper.

You don't by any chance require a cookie to be accepted for users to go deep into your site, do you?

vincevincevince




msg:728146
 3:04 am on Jul 3, 2005 (gmt 0)

Very strange. If you add &filter=0 to the end of your search results URL - how many do you see?

chicora




msg:728147
 5:21 am on Jul 18, 2005 (gmt 0)

HI - thanks for the help. No, we don't require cookies to browse the site, only for members. Also, adding &filter=0 to the end of the search results URL still produces the same number of results.

I first suspected that google hadn't spidered our pages when we tried adding the Adsense google search function. It produced almost no internal results for any search done.

g1smd




msg:728148
 10:47 am on Jul 18, 2005 (gmt 0)

I have seen this. Try it again with something like:

site:domain.com THE

or

site:domain.com A

I have seen several occasions where adding a word suddenly reveals many of the other pages.

g1smd




msg:728149
 10:49 am on Jul 18, 2005 (gmt 0)

Additionally check whether your pages are indexed as domain.com instead of www.domain.com - if both are accessible (and both serve as "200 OK") then you need to add a 301 redirect as a matter of urgency to fix the problem.

chicora




msg:728150
 5:30 pm on Jul 18, 2005 (gmt 0)

Thanks, very helpful.

Doing a search for - site:domain.com THE - does improve the number of results. About 8,000 are now showing. This does seem to reflect the core content of the site – the pages for health treatments that users can then rate.

Using - site:domain.com A – brings up about 1,000 fewer results. Hard to say how the list differs from “THE”.

A search for site:domain.com brings up 75,000 results. In comparison the search for site:www.domain.com brings up only the 2! However, for the site:domain.com search, the results pages don’t show the page title tags or meta description tag wording. Instead (probably 90% of the time) they just show the url in blue.

So, what does this all mean? Does the adequate results number found in - site:domain.com THE - show that google has actually spidered the pages on my site? If so, why did the google internal search tool fail so miserably when I tried it?

Many thanks.

g1smd




msg:728151
 6:05 pm on Jul 18, 2005 (gmt 0)

All the stuff showing as "URL-only" is probably being suppressed as "duplicate content".

You have two sites: non-www and www - Google treats them separately.

You have also split your PageRank between the non-www and www versions of your site.

If www.domain.com/page1.html is shown in the SERPs and it links to www.domain.com/page2.html, but for "page2 it is domain.com/page2.html (non-www) that is shown in the SERPs then it isn't getting any PR passed from "page1.html" is it?

A 301 redirect will fix this. You need to redirect TO the server default. The server default can be edited in the httpd.conf file if you need it to be the reverse of whatever it is now.

TheGuyAboveYou




msg:728152
 6:30 pm on Jul 18, 2005 (gmt 0)

Hi

If I type site:sitename.com verse site:www.sitename.com I get a difference of about
30 pages? Is this not suppose to happen?

Should I have a redirect? If so what does the line of code look like?

redirect 301?

Thanks

g1smd




msg:728153
 9:10 pm on Jul 18, 2005 (gmt 0)

For Apache, this goes in your .htaccess file; assuming that it is www.mydomainname.com that you want to promote:

Options +FollowSymLinks
RewriteEngine on
RewriteCond %{HTTP_HOST} ^mydomainname.com [NC]
RewriteRule ^(.*)$
http://www.mydomainname.com/$1 [L,R=301]
RewriteCond %{HTTP_HOST} ^my-other-domain-name.com [NC]
RewriteRule ^(.*)$
http://www.mydomainname.com/$1 [L,R=301]
RewriteCond %{HTTP_HOST} ^www.my-other-domain-name.com [NC]
RewriteRule ^(.*)$
http://www.mydomainname.com/$1 [L,R=301]

Omit the last four lines if you only have one domain name.

If you have yet more domains then add another 4 lines for every extra domain that you do have.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved