Welcome to WebmasterWorld Guest from 54.160.131.144

Message Too Old, No Replies

Pages in Google main index are decreasing since Middle of August

     

Cyclob

8:12 am on Aug 28, 2007 (gmt 0)

10+ Year Member



Hi...

I use site:www.mysite.com/* command to check pages in Google main index and the number is decreasing since the middle of August.

I tried to check many things such as double check if they have nofollow,noindex, check on robots.txt to see if it blocks google from crawling the site but everything was set correctly.

Anyone experiencing the same situation as mine?

Thanks in advance for every comment.

tedster

6:33 pm on Aug 28, 2007 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Are you seeing a corresponding increase in Supplemental pages, too? Or is the total number of indexed pages falling (search on site:www.example.com without the *) as well?

SEOPTI

7:07 pm on Aug 28, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes, same situation here, huge increase of supplementals.

StickyNote

7:51 pm on Aug 28, 2007 (gmt 0)

10+ Year Member



huge increase of supplementals

Wow, thought it was just my sites.

TheSeoDude

8:02 pm on Aug 28, 2007 (gmt 0)



Same thing here. And along with supplementals traffic died too.
Only new pages perform.

1.5 months old site, no link exchanges or dirty stuff. My only clean site and Google leveled it after outstanding performance for a new site.

One day about 100+ visits (from 5 pages), the 2nd virtually nothing.

Trying to resuscitate it but I don't know! Thinking of changing old supplementaled URLs. But also thinking of waiting a bit more to see what happens.

PS: Scrapers and stolen content performs much better ;) Google is asking for it with its late behaviour.

Kimkia

8:05 pm on Aug 28, 2007 (gmt 0)

10+ Year Member



Same here. Not a huge drop, but after I submitted the last sitemap, which should have added 20 pages, the site command showed a drop of 9 pages.

How can you tell if pages are in supplemental, now the supplemental tag is gone?

Tonearm

8:10 pm on Aug 28, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Huge decrease in main index pages here. I use site:www.example.* and site:www.example.com. Since August 1st, main index pages have been reduced to 130 from 230, and total pages have been reduced to 670 from 710. I've been adding new pages the whole time.

Is anyone else seeing pages drop out of both of those site: searches?

The problem is I started changing my internal linking structure around at the end of July to get pages out of supplemental, so it's hard to tell what's going on at this point.

edit:
Nothing shady whatsoever and the site is 6 years old.

[edited by: Tonearm at 8:13 pm (utc) on Aug. 28, 2007]

TheSeoDude

8:37 pm on Aug 28, 2007 (gmt 0)



6 years old?

Wow! Thought it was only affecting newer sites.

PS: 2 threads on same thing : [webmasterworld.com...] .

tedster

8:57 pm on Aug 28, 2007 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



One of my clients - 9 year old site - has dropped from 1,700 urls indexed to 1,300. They've never been that low in recent years.

Traffic seems to be at roughly the same levels, however. If this continues after US Labor Day, I'll dig further into an analysis.

TheSeoDude

9:19 pm on Aug 28, 2007 (gmt 0)



ted ;) any site is made of structure and content. Traffic can stay pretty much the same if your 400 missing pages are mostly navigation (structure).
Funny thing is Google hit me only in the content pages. All unique and written by me.

So for you 400 missing pages might not be a big deal but if the missing pages would have been content (those that bring in searchers) you would have had a big problem (I'd say a K.O.).

Kimkia

9:20 pm on Aug 28, 2007 (gmt 0)

10+ Year Member



my site is 4 years old, static html, white hat, high ranking

just checked a competitor's site also - it took a much worse hit than I did, a lot of their forum pages knocked out, I think

trinorthlighting

9:23 pm on Aug 28, 2007 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



If the pages rarely change and contain little or outdated information (Stale) you should expect an eventual drop into the supplemental index.

TheSeoDude

9:36 pm on Aug 28, 2007 (gmt 0)



Any information, excluding news, not updated for one month can not be automatically considered expired and irelevant! So many static sites have been livin' the good life for years in google.

I think they are after fresh meat.

Kimkia

10:13 pm on Aug 28, 2007 (gmt 0)

10+ Year Member



There are hundreds of pages on my site that would be relevant in search results if they weren't updated for the next ten years. It's high quality content that isn't time sensitive in any way.

In any event, as I said, this trend for pages decreasing in the index is hitting my competitor in a worse way, and their site is dynamic, with most pages being short forum entries.

One interesting fact - despite the drop in indexed pages, I'm getting more traffic overall. Each page of mine belongs in one of about 12 separate directories, with each directory having its own home page, so to speak, providing a link, thumbnail and hand-written description of all the content pages under that section, which could be anywhere from 30 to 60 pages. I think these category indexes may be getting more recognition, rather than the individual pages. If so, it works for me.

Tonearm

12:40 am on Aug 29, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Has anyone made any changes in August to try and bring pages out of supplemental?

Edit:
I ask because it would be good to know what isn't working.

[edited by: Tonearm at 12:43 am (utc) on Aug. 29, 2007]

followgreg

1:23 am on Aug 29, 2007 (gmt 0)

10+ Year Member




The problem is that even if you try changing some pages seem not to get indexed since Aug. 1-10 for some reason.

SEOPTI

1:34 am on Aug 29, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Right, you can't change anything, just sit and wait.

Tonearm

1:42 am on Aug 29, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Here's a weird one. I orphaned 20 pages in July that are still in the main index.

[edited by: Tonearm at 1:42 am (utc) on Aug. 29, 2007]

Stefan

2:28 am on Aug 29, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



If the pages rarely change and contain little or outdated information (Stale) you should expect an eventual drop into the supplemental index.

I don't know about that - maybe in some cases, but I have many pages that have been static for years, and none of them have gone supplemental. But they have unique content and are text heavy - perhaps that keeps them where they should be.

Cyclob

8:51 am on Aug 29, 2007 (gmt 0)

10+ Year Member



yes, my supplemental pages also increasing because number of total pages indexed is pretty much at the same level.

I use site:www.mysite.com ==> to check total pages indexed ==> not much change

Then I use site:www.mysite.com/* ==> to check pages in main index ==> keep decreasing

and I subtract those number and the result (supplemental) is keep increasing and the site is 3.5 year old.

TheSeoDude

10:38 am on Aug 29, 2007 (gmt 0)



I made no changes to fix the increasing supplementals, just got a few new links.

Everything happened overnight on the 8th of August. So, as it happened out of the blue with no previous changes on my behalf it must be something from Google.

So I keep adding new content and pray that Google gives a funk.

On the other hand :

Googlebot last successfully accessed your home page on Aug 9, 2007.

Is written in my GWT account. But homepage gets crawled every 2 days and Google gives it HEAD (requests) daily.

I don't know ...

SEOPTI

1:11 pm on Aug 29, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It's simple, 90% less cache updates, 90% less fresh tags, 90% less indexing this August.

skweb

1:14 pm on Aug 29, 2007 (gmt 0)

5+ Year Member



Mine are increasing. In other words, it could be just normal churn.

TheSeoDude

1:28 pm on Aug 29, 2007 (gmt 0)



SEOPTI is it like this every year? It would make sense as August is vacation month for humans so it could be the right time for Googler's to throw in some tests and mess up somehow un-noticed.

But Dugg news appear in a matter of minutes in index. I posted a news and came into serps in about 15 minutes or so.

Weird.

netmeg

2:46 pm on Aug 29, 2007 (gmt 0)

WebmasterWorld Senior Member netmeg is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



I dunno - I had around 500 pages indexed, then they dropped down to 350 last weekend, and now they seem to be climbing again - they're up to 430. But also the site command could just be broken too. I couldn't come up with a relevant search phrase where one of my pages *didn't* show up. And they're all still ranking fine. Traffic is about normal for what it should be this time of year.

whitenight

3:06 pm on Aug 29, 2007 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



But Dugg news appear in a matter of minutes in index. I posted a news and came into serps in about 15 minutes or so.

Actually, this seems to be web-wide. Even Digg.com (and other quickly spidered sites) are updating/ranking much slower than usual. (usually it would take 5-7 minutes for a digg story to be ranking and it would rank higher)

Like Tedster said, if this continues past Labor Day then I would start questioning Goog about what's going on, but right now, it's nothing to worry about as I see it happening to nearly everyone.

TheSeoDude

3:17 pm on Aug 29, 2007 (gmt 0)



Ok ... let's begin the countdown. I've set the counter to 5 days?!

We'll see. I'm reserved about this quick turnaround every1 expects.

PS: I didn't mean the pages from digg.com about the news are getting indexed fast. I meant my page (from my site) with the news mentioned on digg.com got indexed (not just crawled) in less then 15 mins. That is really fast from my point of view and experience.

Matt also mentions smth interesting in his /blog/minty-fresh-indexing/ post about much quicker indexing.

Bewenched

4:17 pm on Aug 29, 2007 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



So can someone explain the differenct between these two commands

with the *
site:www.mysite.com/*

without the *
site:www.mysite.com/

I get VERY different results.

Oh and for the past two days traffic and the phone has been off the hook for us. Today ... crickets chriping. No changes to the site.

iridiax

4:43 pm on Aug 29, 2007 (gmt 0)

5+ Year Member



So can someone explain the differenct between these two commands

with the *
site:www.mysite.com/*

without the *
site:www.mysite.com/

I get VERY different results.

All indexed pages from your site:
site:www.mysite.com/

Non-supplemental pages from your site:
site:www.mysite.com/*

Supplemental pages from your site*:
site:www.mysite.com/ -site:www.mysite.com/*

*Strangely, these may not add up.

DorianWeb

7:17 pm on Aug 29, 2007 (gmt 0)

10+ Year Member



My pages are decreasing in google also.

I have an old site, listed in dmoz, yahoo, and have decent links.

It's a small site with 57 pages. (all pages have been indexed n google for a while). The traffic has been consistent with 150-200 visitors a day.

Recently, the traffic dropped down to 50-100 visitors a day. When I did a site: search in google, the site only has 21 pages listed now.

This 42 message thread spans 2 pages: 42
 

Featured Threads

Hot Threads This Week

Hot Threads This Month