Welcome to WebmasterWorld Guest from 34.238.194.166

Forum Moderators: open

Message Too Old, No Replies

Google finds my pages but then they are gone

find pages gone google

     

the_rookie

11:00 am on Dec 30, 2002 (gmt 0)

Inactive Member
Account Expired

 
 


When google passes my pages it indexes 2 out of 6. The links look as they should. They also display a date next to them, in contrast to many other links.

Then after a few weeks has passed the links dissapare, and they are replayed by an old link with the wrong title of the page.

The pages are listed in yahoo, under a different title but i don't know if that has an effect...

Could someone explain where the problem lies?

Thanks in advance!

11:05 am on Dec 30, 2002 (gmt 0)

Senior Member from ZA 

WebmasterWorld Senior Member 10+ Year Member

joined:July 15, 2002
posts:1723
votes: 4


If you do a site search for Everflux and the Google Freshbot you will find a wealth of information and the answer to all your questions ;)

Craig

11:07 am on Dec 30, 2002 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 26, 2002
posts:53
votes: 0


And when the next google dance (maybe August 2009?) has happened your sites will be listed.
11:10 am on Dec 30, 2002 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member fathom is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:May 5, 2002
posts:4110
votes: 109


Be patience the_rookie.

Minty Fresh (Google's refresh bot) grabbed your pages as "brand new" or "fresh" which helps them get ranked high in results.

Although short lived - when the next refresh update occurs (usually the next day or two) they disappear in favor of "more fresh" pages.

The good side - googlebot now knows these pages exist - you will get listed in the next monthly update (or possibly the one after).

The bad side - refresh ranks rarely reflect actual positions which can be substantially lower in results than you anticipate.

the_rookie

11:58 am on Dec 30, 2002 (gmt 0)

Inactive Member
Account Expired

 
 


ok thanks!

Is there btw fresh data on when google did its last major crawl?

12:04 pm on Dec 30, 2002 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member fathom is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:May 5, 2002
posts:4110
votes: 109


refresh crawls go on daily -- normally right up to the monthly update @ www2. & www3. and usually starting the day after the "dance" to www.google.com.

Refresh data/listings/rankings/pages etc., have nothing to do with monthly crawls, completely independent.

adding... this is why refresh listings tend to rank high, they are comparatively ranked only with pages of that refresh rather than the complete index.

[edited by: fathom at 12:08 pm (utc) on Dec. 30, 2002]

12:05 pm on Dec 30, 2002 (gmt 0)

Senior Member from ZA 

WebmasterWorld Senior Member 10+ Year Member

joined:July 15, 2002
posts:1723
votes: 4


The main big crawl generaly takes place soon after the monthly update, I dont know the actual date of the last one though, or any previous ones though.

Craig

12:05 pm on Dec 30, 2002 (gmt 0)

Senior Member from ZA 

WebmasterWorld Senior Member 10+ Year Member

joined:July 15, 2002
posts:1723
votes: 4


The main big crawl generaly takes place soon after the monthly update, I dont know the actual date of the last one though, or any previous ones.

Craig

the_rookie

1:55 pm on Dec 30, 2002 (gmt 0)

Inactive Member
Account Expired

 
 


Ofcourse I also want google to index all pages, not only 2 out of 6.

In other words, i made certain that the title and description were short enough and that no word was repeated more than three times in the metakeywords.

Is there something else that I could do in order for google to index all pages?

Another question: Does the pagerank calculate those of my pages that are not indexed? I mean if i have all my links to other sites on one page does it matter if it is indexed or no?

thanks again!

[edited by: Marcia at 12:41 pm (utc) on Dec. 31, 2002]
[edit reason] no URLs or tools, please [/edit]

2:05 pm on Dec 30, 2002 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member fathom is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:May 5, 2002
posts:4110
votes: 109


If a page is not indexed it may appear "not ranked" or a "guessament".

Not ranked -- Grey bar; Guessament tends to be the average PR value of the directory level, or PR5 which ever is less (this is based only on observations rather than known parameters).

This really depends what pages (and the links on those pages) were indexed.

Normally Googlebot does a "hit & run" the first time round, don't worry too much, it will return to grab the whole site.

Scrub the web Meta information is rather old - it would be extremely valuable to read up on some of the threads in The Marketing World
[webmasterworld.com] for more updated info.

[edited by: fathom at 2:07 pm (utc) on Dec. 30, 2002]

2:05 pm on Dec 30, 2002 (gmt 0)

Senior Member from ZA 

WebmasterWorld Senior Member 10+ Year Member

joined:July 15, 2002
posts:1723
votes: 4


I think the best you can do is to wait, if you have a good site with some nice juicy paragraphs for Google to read a few links pointing to you from sites that are relevant to yours and that also rank well in Google then there isnt alot else that you can do...

Well.. there are only two things that you can do, try to add a couple of pages a week to your site so that when the Googlebot visits there is always new content for it to read and hunt for those links!

Have a read of this post from Brett:

[webmasterworld.com...]

Good luck :)

Craig

2:06 pm on Dec 30, 2002 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member fathom is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:May 5, 2002
posts:4110
votes: 109


What... are we in a race here creative craig! ;)
2:09 pm on Dec 30, 2002 (gmt 0)

Senior Member from ZA 

WebmasterWorld Senior Member 10+ Year Member

joined:July 15, 2002
posts:1723
votes: 4


Not scared are we ;)

lol

the_rookie

8:25 am on Dec 31, 2002 (gmt 0)

Inactive Member
Account Expired

 
 


I think I just found a reson to why all pages aren't indexed. I had a broken link at the bottom of those pages, a link that referred to the old site(not found).

So now I'll just need to wait i guess...

Thanks guys!

[edited by: Marcia at 12:40 pm (utc) on Dec. 31, 2002]

12:23 pm on Dec 31, 2002 (gmt 0)

New User

10+ Year Member

joined:Dec 31, 2002
posts:4
votes: 0


The link written by Brett below, rocks! However, I dont believe purely that content alone can give a good footing.

I know a site who doesn't regularly update their site, corp info et al that are so old, keeps the products always available for sale, very small market but is ranked very high. I inspected their code, and found nothing special.

Occassionaly I see their ad but that's it. What is the basis of Google for all these? I hope the company is not using tricks but then again if it does Google will be able to find out right away and immediately punish the site.

So what is the real deal?

3:20 pm on Dec 31, 2002 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member fathom is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:May 5, 2002
posts:4110
votes: 109


I dont believe purely that content alone can give a good footing

Here is what superb content can do without any assistance from optimization.

First content should be defined.

Informative, educational value, knowledge or skillset building, interactive demonstration models.

Rarely does a description for a product being resold fall into these categories, but a demo of that product might: shareware, freeware, online versions in Flash, Shockwave JavaScript or other dynamic programming languages.

Something around the theme of "how to..."

So... this has been developed, submit to DMOZ, and get a few links pointing to it (just so Googlebot has a few paths to quickly index), now forget about it.

1. Index in Google - possibly added to DMOZ.

2. A few webmaster, site owners find it & and link.

3. Monitor logfiles noting any referrals & check the page.

4. Add a links page to your page indicating these sites in some meaningful way & link back. In addition, add a "request a link from" offer link anchors/image "gif" for links to you as well as a "add your link".

5. Googlebot crawls these links

6. Index update in Google slight improvement in ranking.

Steps 2 through 6 continue to occur & without 6 - 12 updates your #1.

Start a new informative, educational value, knowledge or skillset building, or interactive demonstration models on a slightly different theme and repeat Steps 1 - 6.

The vast majority of your time was spent developing "content" the remainder of your physical work can be calculated in minutes/month.

Of course you can't do this with just any old blog of information - people have to want it for content development to work.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members