homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

This 68 message thread spans 3 pages: < < 68 ( 1 [2] 3 > >     
Successful Yahoo Reinclusion Request?
Seeing Heavy Crawling

 4:19 pm on Aug 19, 2005 (gmt 0)

Hello all,

We recently purchased a large, well established site (about 20,000 pages of original content) that (for various reasons - no balckhat, just spammy stuff like too many affiliate links, etc.) had been banned from the Yahoo Search Index about 3 years ago (according to the former owners).

The site is listed in the yahoo directory, but - despite having 10,000+ inbound links, and ranking very well every where else, could not be found anywhere in Yahoo when searching for it. The front page and only the front page was crawled 1-2 times a day by Yahoo/slurp, but no other pages were crawled.

After refreshing the site and updating it quite a bit (not to mention removing virtually all affiliate links), to include adding RSS syndication to the original content (which got picked up by several RSS hubs), we submitted a verbose reinclusion request, outlining all we thought the site did wrong, and everything we've done to improve it.

Today, we're getting absolutely slammed by the following crawler:

YahooSeeker/CafeKelsa (compatible; Konqueror/3.2; FreeBSD ; [help.yahoo.com...] (KHTML, like Gecko)

My question is this: Is that crawler hitting us due to the new RSS feed we are providing, or are we about to be reinstated into the search index?



 9:23 pm on Sep 13, 2005 (gmt 0)

I'm not 100% sure if my site was banned, since a links: search is still showing plenty of inbound links from other sites. Just a site: search is showing no internal links, and my site is still being spidered by Slurp.

Some doorway page programs such as rankingpower can actually create heavy crosslinking and interlinking by capturing many of your own listings that happen to reside in the altavista search results for your keywords, where the software "borrows" the content. This is what happened to me.


 2:25 am on Sep 14, 2005 (gmt 0)

Guys... I have Yahoo willing to re-examine our site. Just got the email tonight.

Right now we use a do not follow tag on every link but we've seen in the past that Yahoo does not even respect robots.txt all the time so we are unsure about this.

There are people here who say you should use code so the spider does not follow them. We really are trying not to spam but interlinking is important for our customers and ourselves.

Can anyone give me an example of how to do this?


 8:19 am on Sep 14, 2005 (gmt 0)

i think the spoke linking is used mostly to avoid interlinking. So all sites link to one holding site that then links back out to all the others.


 4:25 pm on Sep 14, 2005 (gmt 0)

Whats the thinking then? If you were banned and then reincluded, would the SE's put some sort of other penalty on the site so that the once banned site would not rank well. That does not make sense to me as the SE would not reinclude a site if it was not totally clean, so whats the point of a further penalty? But maybe they might want a period of probation!


 4:47 pm on Sep 14, 2005 (gmt 0)

we're just talking Yahoo. They seem to operate in a way not followed but other search engines. In terms of Yahoo thats what a ban is, a total demotion penalty. So you may have your index page rank for some obscure phrase or keyword but it will rank last or near to last for something it would rank top for without the demotion penalty applied, like a unique company name. I think you'll find other engines will ban you ouright in the true sense. Also no page other than the index page is indexed.


 6:01 pm on Sep 14, 2005 (gmt 0)

I have been a long time banned, but have not thought about it much for a while

However, after reading this thread I may have a crack at a reinclusion mail..after all I don't think I am black hat!

Does Yahoo! consider resource/links pages as spamming?

I have 8 of them linked discreetly at the bottom of my index page, should I delete them before I do the reinclusion request?

I can't think of any other reason why they could have
banned me.


 8:56 pm on Sep 14, 2005 (gmt 0)

it seems the number of recips will decide if they class it as spamming...8 sounds pretty reasonable to me..but then wot do i know! :)

actually did you mean 8 pages or 8 links?...


 11:25 pm on Sep 14, 2005 (gmt 0)


Have your pages/rankings returned after you saw the heavy crawling nearly a month ago?



 12:23 am on Sep 15, 2005 (gmt 0)

Yahoo's email that lets you know your banned says you get ONE chance to have it reviewd for resubmission.

Im wondering if I use that express submit (for the search not the directory) and see if it goes through - then if it gets rejected I can try additional changes and send it back in for free resubmission.

what do you think? I did remove a bug from my site (it was pulling in a content page with broken images and content for 404's - that has been removed but i don;t know if thats why they banned it)

but they wont tell me if that was the problem and I don't want to resubmit it and have it rejected if I only get one more chance - I have a lot of pages in my directory but they are not doorway pages or cloaked or anything - I do quite well with Google and MSN and have thousands of backlinks from just as many web sites within my site category


 1:17 am on Sep 15, 2005 (gmt 0)


[edited by: martinibuster at 4:37 am (utc) on Sep. 15, 2005]
[edit reason] Publishing content of emails violates the TOS. Thanks. [/edit]


 1:25 am on Sep 15, 2005 (gmt 0)

Here is my situation... I've got over 800 articles - no joke. Been writing them for nearly two years. I used to do pretty well in Yahoo up until the middle of June.

I tried a reinclusion request, explaining what I thought might be the problem (the server returning a 301 to the home page instead of a 410 or 404). I thought this might have caused a duplicate content penalty.

I explain all this nicely. The above is the response I get. I've done this twice already. Both times I got the same exact response.

My website currently show 860 pages in the Yahoo index, none of them showing a cache. Only the home page can be found when searching for unique content. All but 75 of the 860 pages are showing URL only.

Am I getting a manual penalty or is the algo saying I'm a bad guy. Personally, I would think the site would pass any manual review. It's clean. Any guesses?


 1:36 am on Sep 15, 2005 (gmt 0)


I read that as you only get one review - it says they are not able to offer the option of another review -

but you are saying you received this email twice? so they have reviewed it twice already?


oh yahoo what have you done...
what have you done?

[edited by: martinibuster at 4:39 am (utc) on Sep. 15, 2005]
[edit reason] Can't publish content of emails. Thanks. [/edit]


 1:47 am on Sep 15, 2005 (gmt 0)

I don't get it either. Here is more information. Both times I submitted the request, I got a response back within 24 hours. I checked the server logs and could find no evidence that anyone was "looking around." I did this by painfully examining where all our visitors came from in the hour prior to the email being sent to us.

Personally, I think this is some kind of algo penalty - not a manual. Slurp still visits our site and grabs pages daily, but at a much slower rate (500 per month compared to 2,500). I know a lot of black hats claim foul, but I'm not interested in that game. (There's too much to learn being a white hat, let alone a black one.)


 5:13 pm on Sep 15, 2005 (gmt 0)

Lets face it, no search engine is perfect.

If yahoo algo is filtering out/banning genuinely good sites, it is really yahoo's loss.

I have seen some really nice sites which sometimes face this problem on yahoo search.

What yahoo could consider is to charge a small fee for a manual reinclusion request - and show the webmaster where the problem is.


 7:37 pm on Sep 15, 2005 (gmt 0)

What yahoo could consider is to charge a small fee for a manual reinclusion request - and show the webmaster where the problem is.

That's a great idea. Give those of us that want to be included a chance to see what they object to. I am at a loss and so are others that have taken a look.


 8:05 pm on Sep 15, 2005 (gmt 0)

Thats good ole Yahoo. Once your banned your screwed. get a new domain, new links and do it that way. they want people to play by the rules when they don't.


 10:20 pm on Sep 15, 2005 (gmt 0)

It is very difficult to get the Yahoo penalties lifted. I have a site that used to be an affiliate site. All the affiliate links are gone and it is still getting rejected by Sitematch. :(

Keep trying and working to improve your site, that's all you can do.


 6:10 am on Sep 16, 2005 (gmt 0)

"Once your banned your screwed. get a new domain, new links "

Webmasters would be tempted to create multiple sites and this is SPAM.



 6:23 am on Sep 16, 2005 (gmt 0)

Difficult doesn't mean impossible, though.


 12:43 pm on Sep 16, 2005 (gmt 0)

Hey Guys

This reinclusion thing really does work! Yahoo really listens and gets back to you right away.


Here was my situation. I made some normal onsite optizmation tweaks, changed my title tag and did some internal url page address changes to be more spider friendly. You get the idea the everyday life of a webmaster etc.....

Anyways, right after I made those changes, a day or two later my site was gone from the Yahoo index.

I was shocked! I did not understand what or why I was dropped. I then waited two weeks and still no changes.

Then last night I decided to email Yahoo and ask for them to review my website for reinclusion. I explained to them exactly what I just told you guys and to my amazement when I woke up this morning my site was back online and indexed within Yahoo search results!

I cannot believe it. It was that simple! All this time I was pulling my hair out hoping and waiting they they would reinclude me.

Here is the key. If you have a clean site and you follow the Yahoo guidelines, if you write them they will hear you and gladly help you out.

They are in the business to post highly relevant results on their engine and if your site belongs there, they will help.



 2:13 pm on Sep 16, 2005 (gmt 0)

This is for the Yahoo search index, and not the Yahoo Directory correct? I had a site recently banned, most likely because I was using doorway page software - hundreds of them. I got rid of all those pages and I'm working on rebuilding the site. I trust they will be just as receptive to me when I ask for reinclusion and I'm honest about my past wrongdoing.

I lost a lot of traffic and sales because of this.


 4:05 pm on Sep 16, 2005 (gmt 0)

I'm not sure, but I think it was a joke...


 5:20 pm on Sep 16, 2005 (gmt 0)

How's this for an honest reinclusion request?

Dear Yahoo Team:

My website [......] was recently dropped from your Search.Yahoo index, and I would like to ask you to please consider my site for reinclusion.

At the time, I was using a doorway page generator called "Rankingpower" to generate large numbers of "keyword" pages, which most likely resulted in this penalty. I have since discontinued my use this program and have completely removed all of it's pages. I have reviewed your Content Policy Guidelines. I apologize for having violated your guidelines and I promise to never use this or similar program again.


 5:27 pm on Sep 16, 2005 (gmt 0)

No Joke Guys! True Story :))

Was gone and then requested reinclusion to the Yahoo index and inside of 12 hours I was back.

If you have a clean site then their should not be any problems getting back in.

If you play games what you have done is create a bad track record and it may take a while (a long while) before you are let back in to play.

I think what happened in my case was a simple oversite by Yahoo that was quickly resolved.

My point is that I am here stating a fact. If you want to believe it, its totally up to you. That fact is that Yahoo does respond to your requests. Whether its good or bad.

For example: A "Yes" response is case and point, a request for reinclusion that was granted.

A "No" response is indeed a response from Yahoo telling you they are not ready to let you back in.

What I am getting at here guys is that their were no words or emails from Yahoo indicating that they heard my request for inclusion.

The fact is that they responded almost immediately "without words" but by action, by the reinclusion of my site.

A non response or "No" response is indeed an action or response from Yahoo. Stating loud and clear they are not ready to let you in and play just yet.


 6:28 pm on Sep 16, 2005 (gmt 0)

No Joke Guys! True Story :))
Was gone and then requested reinclusion to the Yahoo index and inside of 12 hours I was back.

I would be tempted to call that a coincidence. Even if you were reincluded because of your request, many here have said it takes days to weeks to get respidered and reincluded.



 8:55 pm on Sep 16, 2005 (gmt 0)

If a website is cleaned up and all violations removed, can reinclusion sometimes eventually occur automatically on it's own as long as Slurp keeps spidering and you don't reoffend?


 8:55 pm on Sep 16, 2005 (gmt 0)

My site held a #2 web result for nearly 5 years.
On April 1st, my ranking began to drop. Now I'm down around #30 and bobbeling around.
The web directory has my site listed in the #2 spot and I show 255 pages in site:mydomain.com .

The stuff that is above me is non related garbage.

Is it possible that a competitor could submit my site every day, for months, then get me booted for search engine spamming?

submitexpress.com has that damn free submit tool, which I am told (by them) is anonymous.

One of my competitors has tried everything (including placing my email address in kiddie porn lists and sending spam using my email addresses) and since April he went from #30 to #2.

Sucks, don't it?


 11:04 pm on Sep 16, 2005 (gmt 0)

I just wrote a freakin essay to yahoo

keep my hooves crossed...


 4:52 pm on Sep 17, 2005 (gmt 0)

yahoo responded in 4 hours (on a friday evening even!)
but the response doesnt say if they accepted it or not - it says "check in a few weeks to see if we accepted it"

inktomi and slurp have not been around so I don't think it looks good...


 10:12 am on Sep 19, 2005 (gmt 0)

I got exactly the same thing i think its just an autoemail give it some time matey and see what happens


Broker Boy


 12:34 pm on Sep 23, 2005 (gmt 0)

Hi Guys

Maybe you all are going about this the wrong way. Or maybe you have underlying problems regarding your sites that you cannot talk about, I am not sure.

I wrote Yahoo yesterday explaining that they have all my pages but they have not indexed them yet.

I asked them politely why? And then went on to tell them how long I have been waiting and also that I am in their paid directory etc....and would appreciate getting my pages indexed.

Again within 24 hours they got back to me. Now I did not receive any emails or anything like that but they did index over 300 of my pages.

Now most of you are going to tell me pure luck. I don't think so. This is the second time I contact Yahoo in a month and both times I got results.

Not in words but in action.

Yahoo does listen! Thanks Yahoo.

This 68 message thread spans 3 pages: < < 68 ( 1 [2] 3 > >
Global Options:
 top home search open messages active posts  

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved