Welcome to WebmasterWorld Guest from

Forum Moderators: martinibuster

Message Too Old, No Replies

Pages not cached

If none of the pages are cached, that means I am banned?



4:02 pm on Nov 16, 2005 (gmt 0)

10+ Year Member

hey folks

When I search for site:www.mydomain.com I see ~68 results, but none of the pages are cached. That means I am having a penalty?

I am kinda confused


11:11 pm on Nov 16, 2005 (gmt 0)

10+ Year Member

I your pages are not cached, it means that you used
a meta tag like :



4:49 pm on Nov 20, 2005 (gmt 0)

10+ Year Member

No, I am not that stupid :)


4:58 pm on Nov 21, 2005 (gmt 0)

10+ Year Member

We have a situation where site:foo.com shows a large number of pages but very few pages are actually findable with a regular search if you search for a unique text string. The ones that are findable are cached. This amounts to "banning" since our traffic to this site from Yahoo to the very small number of findable pages is negligible. Their spider accesses robots.txt 50 times a day but otherwise doesn't spider that site any more.


11:38 am on Nov 22, 2005 (gmt 0)

10+ Year Member

If yahoo bot hits mainly robots.txt you're penalized.


1:43 pm on Nov 22, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I don't have robot files, but I had the same problem yesterday, I think there is something going on.

But I saw some improvements.


3:26 am on Nov 23, 2005 (gmt 0)

WebmasterWorld Senior Member billys is a WebmasterWorld Top Contributor of All Time 10+ Year Member

I don't have robot files.

I cannot understand how someone can run a site without one of these...

A 1:1 robots to page hit rate is a good indicator of a penalty.


9:08 pm on Nov 23, 2005 (gmt 0)

I have the same problem with yahoo.


gives 100results. but any direct text I oh type in brings up no results.

any thoughts


9:15 pm on Nov 23, 2005 (gmt 0)

10+ Year Member

Even if you don't have robots.txt, Yahoo slurp will attempt to access robots.txt in your root directory and you will get a 404 log entry.

We think we have the same problem in one of our sites. It was banned. We fixed it up to eliminate anything that might be considered abuse such as www.foo.com and foo.com delivering the same content and applied to be unbanned. Slurp came back and eventually we started to see more pages indexed. But now slurp only accesses robots.txt (50 times a day) and we are down to six pages in the index so it looks like we are "re-banned". We are totally mystified as to what could be causing the problem.


5:21 pm on Nov 25, 2005 (gmt 0)

10+ Year Member

Do you get any traffic at all from Yahoo? If your traffic went from something to ZERO, then you may have been banned. Otherwise, it's another wierd search engine issue that will *most likely* work itself out in time. Just keep writing content and getting links and staying far away from spam and the rest will take care of itself.

Featured Threads

Hot Threads This Week

Hot Threads This Month