Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Offensive content reduction: On/Off

filter reduces the amount of offensive material



5:26 pm on Nov 11, 2002 (gmt 0)

10+ Year Member


this is my first posting after reading for a couple of month in this forum.

I am webmaster of a very little site - a subdomain about books of a very special social topic with partnership links to a great online book store.

Is there everybody who can tell me more about this filter and how to deal with? what is the fast definition of "offensive material"?

the most of my pages are filtered out, but not all.

thank you


6:39 pm on Nov 11, 2002 (gmt 0)

WebmasterWorld Administrator engine is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Hi and welcome to WebmasterWorld.

I read the page provided [alltheweb.com] and it does say it's not 100% accurate.

I can only guess that it's a filter looking for the most common words, phrases and filenames that have been defined by FAST as "offensive." If those words appear on your site it would explain the missing pages when the filter is on.

I doubt we'll get to know the list, however, you could build your own list by looking for the missing pages and compiling the possibilities into a spreadsheet or database.


9:50 pm on Nov 11, 2002 (gmt 0)

10+ Year Member

Thank you, for this reply.

If I perform searches with words which could be markted as "offensive" and with the filter switched on, then I get a less results number in top of the SERPs as after search without this option. But I get results!

Surely the filter checks combinations.

But I have the idea, my problem is of the mixture of English and German. There are any english keywords and also english books at the pages, but the most text is in German.

Could it be that the filter algorithm is depending on the density of may-be-offensive words? And the filter only counts english words to calculate it, because it only deals with english contents?



10:00 pm on Nov 11, 2002 (gmt 0)

WebmasterWorld Senior Member heini is a WebmasterWorld Top Contributor of All Time 10+ Year Member

h_b_k, where do you check? ATW (AlltheWeb) checks only for english words. T-Online nevertheless filters Fast results for german words.
Not sure if for example T-online would use both filters for mixed english/german content. Wouldn't suppose so.
It would need some testing with cross checking results between T-online and ATW with filters on/off.


10:10 pm on Nov 11, 2002 (gmt 0)

10+ Year Member

I have checked both alltheweb.com and t-online.de search

With alltheweb.com I have the opportunity to toggle the filter option off and on.
Using t-online.de with my test phrases, then I get the filtered SERPs.

At t-online SERP there is also an option to toggle "Familienfilter ausschalten"/"Familienfilter einschalten". (family filter)
After toogling the filter option to "off", I can see the same results as with ATW filter off.
This means that t-online results are pre-filtered with english phrases?

Looking at the other results in t-online.de SERPs, my content could not have any problem with the german family filter. But it has no chance because of the english filter.


1:05 pm on Nov 12, 2002 (gmt 0)

10+ Year Member

me again,

the same problem is with lycos.de search

the normal search with my keyphrases brings the same results as ATW with option "on".

you have to use lycos extended search to switch this option off.

the difference between the results:
all pages (not only my own pages) which are filtered out by english FAST filter are german pages with references to english articles or books.


11:46 am on Dec 2, 2002 (gmt 0)

10+ Year Member


after checking my serp positions, I can tell my "solution":

I have deleted all english keywords from my meta definitons.

this leads to the result, that the most of my pages are available now with "Offensive content reduction: On".

other pages contain (obviously) book titles and descriptions with anglicisms which are "offensive" (in america and norge but not in germany?)

I came to the result: there can't be any international filter word lists. culture is not international.


Featured Threads

Hot Threads This Week

Hot Threads This Month