It appears that my site is number three for most of my major search terms but only with the offensive content filter turned off. Most of my competition is shown whether the filter is on or off and they have the same content. I would like to add that I do not consider any of it offensive although this could be a judgement call I guess. Does anyone have a clue as to what ATW is looking for and how I may fix this problem? What exactly is considered offensive? Is the whole site filtered in this fashion? It's really frustrating to see the competition use the exact same words and advertise the same content and be in the index while you are being filtered out (since the filter is on by default it's like not being in the index)! Any constructive comments greatly appreciated.
I tried searching their site (well, using alltheweb) and still couldn't find any solid info.
Perhaps you could take a closer look at a 'unique word list' of your competitor's site(s) and then match that witha 'unique word list' from your page(s) and then try spotting the language that you have which they lack?
That would take some time & analysis, but it would be a bit better than idle speculation about their filtering mechanisms, perhaps.
Though hopefully, another member has an idea for a method which will work & be quick.
I've done some careful comparisons between my "offending pages" and the competition's and indeed the only differences seem to be in the meta tags. I am using an SSI header on many pages of my site and it turned out that only these pages were affected. This however made it easier to isolate the "offending word." I will post an update as to how things turned out as soon as the changes are updated to the new index.
Well the problem persists. However, I am still waiting for something to happen. A lot of new pages which I've created are not yet included in the index so it appears as though ATW hasn't had an update.
Perhaps someone else knows whether ATW has performed an update of their index?
<updated>I actually just found some answers to my questions in the "ATW Updates" thread </updated>