Forum Moderators: open

Message Too Old, No Replies

Google playing games?

Strange Google visits ......

         

jaxman

11:40 am on Nov 27, 2002 (gmt 0)

10+ Year Member



Well this happened to me 3 times now in the last 3 months and now I don't know what to do anymore.....

In the lpast 3 months I've been 3 times listed in google like about 4 days max and then my page was gone ....

This week I have been visited by google 3 times (I could see it from the Cache date shown by Google) and today ... I am gone again!

Why is this happening?
It was only a fresh bot or was the real update that picked up my site this week?
It is maybe because my web is ".dk"?
I came between the first 5 listed links listed in search and now ... gone. :(

Can somebody bring some light please!
Thank you.

jdMorgan

5:47 pm on Nov 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



jaxman,

Sounds like the freshbot knows about your site, but the deep-crawler hasn't crawled it for some reason.

Pages crawled by the freshbot are only listed temporarily - Only the deep-crawl results in a "stable" listing.

Make sure you've got a few incoming links from sites listed in Google's index, and that your robots.txt file and <meta robots> tags are correct.

There are many threads here on WebmasterWorld discussing this subject. Try a WebmasterWorld site search [searchengineworld.com] for "google dropped site".

HTH,
Jim

jaxman

9:56 pm on Nov 27, 2002 (gmt 0)

10+ Year Member



Are "robots.txt file and <meta robots> tags " a must for your site to be listed in google?

I know I have one more site that is there all the time without using any "robots.txt" or other robot tags.

jdMorgan

10:06 pm on Nov 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



jaxman,

The short answer is no, you don't need robots.txt or <meta robots> tags.

However, not having a robots.txt file adds a 404-Not Found error to your logs every time a robot comes by. So having a robots.txt file - even a blank one - isn't a bad idea.

There has also been some discussion here of Ink's Slurp robot (not sure, maybe another 'bot). It reportedly defaults to index,nofollow if you don't include your own <meta robots> tag telling it to index,follow.

Jim

jaxman

12:40 pm on Nov 28, 2002 (gmt 0)

10+ Year Member



Well , I have modified the meta tags in my index and I did not put any robots.txt yet.
I want to see if it will work without it , the other site I have launched in september it is on google and stays there.

I am still wondering anyway ... my site is up since 20 October or so but I am still not listed , it is true that Dmoz listed me ony early this month but still...it is 28 November ...

I am wondering if Google looks on the Danish part of the Dmoz (With Danish names and words and all that).

I am so nervous and I don't know what to do anymore because as long as the little tricky fresh bot came to visit me I had lotsa visitors coming from Google and for my business it is important.

There is no way to get listed in Google by paying?
I hate waiting and waiting.