Forum Moderators: open

Message Too Old, No Replies

Google won't refresh my site anymore...pls help

         

mmontala

5:06 am on Nov 12, 2003 (gmt 0)

10+ Year Member



Hello, I just like to consult my problem about my site
not being refreshed by google.Since my site got listed in
Yahoo and Dmoz, my site was frequently updated by google.
But when I uploaded a robots.txt( Useragent:* Disallow: ) file, I observed it was not being visited anymore. I don't know how to access the log file because my site was hosted on a free hosting service ( bravenet ). How long will it take for google to crawl on my site again? does the robots.txt affects the crawl or indexing? Pls help. Thanks.

coosblues

7:02 am on Nov 12, 2003 (gmt 0)

10+ Year Member



Your robots txt file looks fine, but if you are having doubts that may be your problem just upload a blank robots text file (assuming you want your entire site crawled). Just how long has it been since you've been crawled, and more importantly did the problems start after you uploaded your robots text file?

mmontala

9:19 am on Nov 12, 2003 (gmt 0)

10+ Year Member



Thanks for replying coosblues. If my memory serves me right, the last update I've seen on google was Nov. 4, 2003. What boggles my mind is the one I'm seeing now in google is an old cache, older than the one i've seen on the Nov. 4. It looks like that it switched back to the old one, probably an Oct. 27 cache, but the page rank didn't change( PR5 ). Just on case, I immediately removed the robots.txt to be sure. Maybe coincidence, it started when I uploaded the robots.txt file.

Stefan

8:08 pm on Nov 12, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



What boggles my mind is the one I'm seeing now in google is an old cache, older than the one i've seen on the Nov. 4.

I hope I understood you correctly...

This is totally normal Google activity, to have a page on the days it isn't freshtagged revert to an old cache. For instance, a page of mine that get's crawled almost every day, (about 3 out of 5 days), at the moment will have freshtags most days, but on those it doesn't, the cache reverts to Oct 11. Soon, a newer cache will stick and it will revert to a more recent cache on non-freshtag days.

wanna_learn

11:15 pm on Nov 12, 2003 (gmt 0)

10+ Year Member



Has anybody heard of a problem where google stop crawling the site gradually, then drop it from caching and finally it disappears fully.

if not, I have 2 recent examples

if yes, I need to explore the reason for it

Stefan

12:04 am on Nov 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



A slow death, eh, wanna_learn?

It isn't a common complaint here... usually it's, "My site just vanished from the index!"

Have backlinks disappeared slowly? Are the sites ever freshened up with new pages and a bit of SEO? If a lot of the sites supplying incoming links go missing, and no new ones are found, then that would do it eventually. Google also seems to like a regular addition of new content. It might just be Google death by neglect. A website is like a flower... it must be watered, fed, occasionally pruned, and you have to invite the neighbours to drop by and have a look when it finally blooms. If you ignore it, it just up and drops dead on you.

ADDED:
If it's the home site in your profile, then I have to wonder if you're having duplicate content problems or something. You have a PR5, yet I don't see your site in the top 50 on your keywords, just lots of sites that have your site URL tacked onto the end or are linked somehow. Trying a [yoursite.com...] there were no results, (unless I typed something in wrong), but a search of "www.yoursite.com" shows 43 sites with your URL listed in their text.

Maybe your associates and their sites have managed to kick you out of Google somehow. With a PR5, and a good looking site, (looks good to me), then you don't need all those crap links.... prune out the ones that are messing you up and aim for #1 on your title keywords.

Imho.

mmontala

2:41 am on Nov 13, 2003 (gmt 0)

10+ Year Member



I hope I understood you correctly...

(Sorry, english is only my second language ;) )Yes and thanks for your advise. That's what's happening right now in my site. I guess I have to wait until google update my cache. :)

Google also seems to like a regular addition of new content. It might just be Google death by neglect. A website is like a flower... it must be watered, fed, occasionally pruned, and you have to invite the neighbours to drop by and have a look when it finally blooms.

I guess this is the problem why my site is not being crawled. Before, when I'm making major changes on my homepage, my site is freshtagged 3 times a week. I don't know if I will treat it as a coincidence again but I'll try to change something on my homepage and see if it works. Also, thanks for sharing your thoughts wanna_learn :)

wanna_learn

3:00 pm on Nov 13, 2003 (gmt 0)

10+ Year Member



Stefan
That was a kinda post I was looking at for long, thanks :-)

Have backlinks disappeared slowly
>> Yes, 3 update back 48 approx, 2 update back 32 , last update 28.

Are the sites ever freshened up with new pages and a bit of SEO
>>> Yes, till 10th oct site had a fresh tag twice a week. AND yes fair SEO involved.

It might just be Google death by neglect
>>> This is the only appropriate reason I found.

You have a PR5, yet I don't see your site in the top 50 on your keywords, just lots of sites that have your site URL tacked onto the end or are linked somehow
>>> It used to be in top 3 for all targeted KWS, till 13th October.

Maybe your associates and their sites have managed to kick you out of Google somehow. With a PR5, and a good looking site, (looks good to me), then you don't need all those crap links.... prune out the ones that are messing you up and aim for #1 on your title keywords.
>>> I am skeptic about this too. How can i exactly locate that CRIMINAL Link.

As I said, I have 2 recent examples...one of my other site which is quite old and was quite stable too had a slow death 5 days back.

Any further help on this issue appreciated :-)

wanna_learn

3:11 pm on Nov 13, 2003 (gmt 0)

10+ Year Member



one more thought
By declining no. of backlinks..I might be dumpdown in SERP, but the thing like..
1st Google stop caching the site and drop it completely seems to be the outcome of smth. else.

Stefan

3:28 pm on Nov 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi wanna_learn

I replied to your sticky... hope it helps.

S

wanna_learn

7:00 pm on Nov 13, 2003 (gmt 0)

10+ Year Member



Recent development about the site that totally disappeared from index (even searched allinurl:www.mysite.com , it returned 0 result), this query is now showing 1 page now at www , and 2 pages and www-in BUT without Totle and Description.

Any indication?

synergy

7:30 pm on Nov 13, 2003 (gmt 0)

10+ Year Member



www-in is showing updated versions of my sites.

It's the only datacenter that seems to be showing a new cached version as the other datacenters are showing my site from Sunday the 9th.

Stefan

8:18 pm on Nov 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



wanna_learn, I don't know if this is a factor, but I checked the code for the first 5 sites that link to you, that show via a google search of "www.yoursite.com", and they all have target='_blank' along with your link. This opens your site in a new window. Perhaps someone else here will know if this is spider un-friendly... I don't know myself, I have no incoming links in that form.

synergy

8:45 pm on Nov 13, 2003 (gmt 0)

10+ Year Member



target= has no effect on the spiders. This is for browsers only.

The spiders look for and follow the href=

Stefan

10:08 pm on Nov 13, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Ok, scratch that theory... :-)

Added: Synergy, or any others, if you a few minutes at some point have a look at wanna_learn's situation. His troubles are fairly well described in the thread. There's something odd happening... maybe dupe content on a supposed linking site, (I don't know, just looked through 5 or 6), but when I checked he had PR5 if you paste his homesite url in, sites showing that link to him if you search for his url text, and yet he has slowly vanished from the index.

wanna_learn

11:02 pm on Nov 13, 2003 (gmt 0)

10+ Year Member



Stefen,
this Unknown is killing me like anything!

Some more details
I changed the IP of my site (to enable SSL), a month back it disappeared. I kept the Site at old IP too till I saw Bot crawling my new IP.

That should not be concerned I guess.

t2dman

12:07 am on Nov 14, 2003 (gmt 0)

10+ Year Member



I have had a look at your site. I suggest that you add your keyphrase "RR" a few more times in your text (ie in your description "The land of..." and create another place. It only appears once in text and that is in a link. Google prefers its description text when its not in a link.

I also suggest that you include the whole two word phrase in <h1> not just one word.

You should also mention your other keyphrases in your text "R Hotels", "R Tourism" ... The word tourism only appears in your title and text links pointing to you.

Stefan

2:32 am on Nov 14, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Good advice, t2dman, but it looks like there's something more serious going on. He doesn't show up in the index at all... looking at his site, it doesn't seem like it's anything he's done, other than having most of his links from link directories etc, and I bet it's one or more of those "associates" that are causing him problems. He isn't trying any dodgy SEO tricks... I'm guessing it has to do with his incoming links.

wanna_learn, it would be good if you got an ODP listing, Yahoo directory, a few solid links like those. All those sites linking to you are mostly just sites with lists of links with no content... they're parasites and they're messing you up somehow. You need to not only track down your problem, you need some solid links like online magazines, articles etc.

There are a lot of supposed SEO "experts" here, (and I'm sure not one)... perhaps one of them could cough up a bit of expertise and figure out what's going on.

wanna_learn

11:12 am on Nov 14, 2003 (gmt 0)

10+ Year Member



t2dman,
Agree with all your suggestions and thanks for that. :-)

However istead of making this thread site specific, I wanted to raise the isuue of so called "Slow Death".
Lots of Webmasters complaint the same phenomenon, few of them returned back on changing their Host.

I too tried it but No Luck Played.

Are there any guidelines to find the specific Malicious Link?

Help so far is really appreciated. This Forum has been very useful.

wanna_learn

5:36 pm on Nov 14, 2003 (gmt 0)

10+ Year Member



Just Noticed
For the KW I am tracking..I see few more sites on 2nd-3rd SERP which have no chache - no title - no description , still its listed.

It dont use No cache tag!

is this No-Cache has been a common phenomenon?

mmontala

3:58 am on Nov 17, 2003 (gmt 0)

10+ Year Member



Soon, a newer cache will stick and it will revert to a more recent cache on non-freshtag days.

Hello stefan, the suspense is killing me. I've been waiting for google to crawl and freshen my cache but until now there seem to be no changes. It's been two weeks now. Base on your experience, how long did it take before you have a newer cache?

I'm expecting that googlebot will prioritize sites that are listed in the google directory. But I observed that after my site was added, this thing happened. Is there any relationship between those events?