homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

Pages not cached
If none of the pages are cached, that means I am banned?

 4:02 pm on Nov 16, 2005 (gmt 0)

hey folks

When I search for site:www.mydomain.com I see ~68 results, but none of the pages are cached. That means I am having a penalty?

I am kinda confused



 11:11 pm on Nov 16, 2005 (gmt 0)

I your pages are not cached, it means that you used
a meta tag like :



 4:49 pm on Nov 20, 2005 (gmt 0)

No, I am not that stupid :)


 4:58 pm on Nov 21, 2005 (gmt 0)

We have a situation where site:foo.com shows a large number of pages but very few pages are actually findable with a regular search if you search for a unique text string. The ones that are findable are cached. This amounts to "banning" since our traffic to this site from Yahoo to the very small number of findable pages is negligible. Their spider accesses robots.txt 50 times a day but otherwise doesn't spider that site any more.


 11:38 am on Nov 22, 2005 (gmt 0)

If yahoo bot hits mainly robots.txt you're penalized.


 1:43 pm on Nov 22, 2005 (gmt 0)

I don't have robot files, but I had the same problem yesterday, I think there is something going on.

But I saw some improvements.


 3:26 am on Nov 23, 2005 (gmt 0)

I don't have robot files.

I cannot understand how someone can run a site without one of these...

A 1:1 robots to page hit rate is a good indicator of a penalty.


 9:08 pm on Nov 23, 2005 (gmt 0)

I have the same problem with yahoo.


gives 100results. but any direct text I oh type in brings up no results.

any thoughts


 9:15 pm on Nov 23, 2005 (gmt 0)

Even if you don't have robots.txt, Yahoo slurp will attempt to access robots.txt in your root directory and you will get a 404 log entry.

We think we have the same problem in one of our sites. It was banned. We fixed it up to eliminate anything that might be considered abuse such as www.foo.com and foo.com delivering the same content and applied to be unbanned. Slurp came back and eventually we started to see more pages indexed. But now slurp only accesses robots.txt (50 times a day) and we are down to six pages in the index so it looks like we are "re-banned". We are totally mystified as to what could be causing the problem.


 5:21 pm on Nov 25, 2005 (gmt 0)

Do you get any traffic at all from Yahoo? If your traffic went from something to ZERO, then you may have been banned. Otherwise, it's another wierd search engine issue that will *most likely* work itself out in time. Just keep writing content and getting links and staying far away from spam and the rest will take care of itself.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved