Forum Moderators: mack

Message Too Old, No Replies

MSN and Subdomains

MSN and Subdomains

         

jrs_66

3:31 pm on May 4, 2005 (gmt 0)

10+ Year Member



It seems that MSN has dropped all of my 100+ subdomains from its index. They are not webspam, they are original, frequently updated 'microsites'. Any ideas? thanks.

Lord Majestic

3:36 pm on May 4, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Did you use subdomain part of the domain as keywords, possibly more than one separated by a '-'?

How many pages did you have per subdomain?

jrs_66

5:01 pm on May 4, 2005 (gmt 0)

10+ Year Member



Yes, they are somewhat related to search phrases- although not completly. There are probably 5 to 25 pages per subdomain.

Shurik

10:46 pm on May 4, 2005 (gmt 0)

10+ Year Member



I've noticed a major devaluation of subdomain sites lately. Couple of my competitors dropped out completely. They both had keywords in subdomains and were indeed classic "build for AdSence" type of sites.

Lord Majestic

11:14 pm on May 4, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



There are probably 5 to 25 pages per subdomain.

Well, perhaps high number of subdomains, and low number of pages per domain triggers spam filter (ought to be some exceptions for major sites). Hardly suprising given amount of spam involving keywords in subdomains.

jrs_66

7:55 pm on May 5, 2005 (gmt 0)

10+ Year Member



Our site is not based on AdSense- don't use it.

Our subdomains are not based on spam keywords- we have a 'microsite' concept which which spilts content based on geo locations (states, provinces, countries).

Does anyone have evidence to suggest that we may be readmitted if the quantity of subdomains is scaled back?

Lord Majestic

8:06 pm on May 5, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



we have a 'microsite' concept which which spilts content based on geo locations (states, provinces, countries).

No offence but it sounds like local spam to me: any site that has an unusually high number of subdomains is really a major spam suspect. Pretty much only valid exceptions that I've seen are sites that belong to big ISPs who create subdomains for customer's webpages. There are not that many of those, and content of pages on each of subdomains will certainly be very different.

IMO anyone who is using lots of subdomains is really asking for trouble.

steveb

1:38 am on May 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



MSN is still overflowing with subdomain garbage, but the recent update did apparently devalue subdomain-keywords slightly. The knob needs to be turned another six or seven miles, but at least some positive development.

jrs_66

2:37 pm on May 6, 2005 (gmt 0)

10+ Year Member



I insist, our pages are not spam. Each geographic location has completely different, useful info- dedicated to that specific location.

I have noticed, however, that it seems it's our generated html pages which are not indexed, where our dynamic (CFM) pages remain in the index. Curious...

Lord Majestic

2:57 pm on May 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I insist, our pages are not spam.

You see, you might just be right, but from what you said on here it seems to me that your site has strong signs of spam:

1) multiple subdomains, probably found as keywords in text, even title of the page?

2) generated html pages: probably very simílar to each other, just what % of text is different on each of them?

Bottom line is this: subdomains historically being meant to be used to split data into major areas, like www.example.com for website, ftp.example.com for FTP, alpha.example.com for test area etc.

When search engine comes across your kind of subdomain usage then it is hardly suprising it is marked as spam. They may not have detected that you machine generated your pages, but if they did then it is reasonable to expect algorithm to flag you as spam. Its nothing personal, just an algorithm: from what you have described you are more similar to spam pages than not.

surfgatinho

3:24 pm on May 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I think MSN were giving to much weight to both domain and subdomain names.
I guess they have compensated wrt subdomains. I don't think it would be a very bright, logical thing to penalise subdomains though.
If I were in charge I'd give them about equal weight to folder names in the URL

Lord Majestic

3:29 pm on May 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It seems to me that usage of high number of subdomains that act as keywords to give extra weight to a handful of pages on each subdomain is a clear sign of spam or SEO over optimisation, especially if its reinforced by high similarity of (machine generated) pages on said subdomains.

jrs_66

3:42 pm on May 6, 2005 (gmt 0)

10+ Year Member



Another site of ours...

Contains ~30 subdomains, each named for a particular, topical, contributing author. We have between 100-500 completely unique articles written by each author. Each article is generated html. The sub domains are used solely to keep the authors happy (they have nothing to do with search keywords). This is a perfectly legit use of the 'microsite' concept- there, in theory, is nothing inherently 'wrong' with using subdomains.

The site also contains a large amount of topical news (about 50 articles per day). This news is not generated.

MSN is indexing all news content, but not the original, generated article content. The only page similarities are the general navigation structure.

It seems, Lord Majestic, this throws most of your speculation out the window. MSN seems to be discarding all pages which it determines to be generated (something which many serious content publishers are doing today). It's no wonder that MSN's results are so poor...

Lord Majestic

3:48 pm on May 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



There could be many other reasons why they don't index that other content.

I'd say 30 subdomains is not high enough to be set as trigger threshold, but 100 is just a nice round number that is temping to be used as treshold for that.

It is likely that spam is judged by a complex formulae that looks at a number of elements, which is why it hard to say which one was the most responsible in any given case.

steveb

7:36 pm on May 6, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"I don't think it would be a very bright, logical thing to penalise subdomains though."

There certainly is no evidence of penalizing them at this point that I can see. Maybe less "valuing them like gold". At some point a lot of subsomain pages will drop like a rock because their only positive algo ingredient is the keywords in the subdomain (and usually many blog links too). When this happens it won't be a "penalty".

"If I were in charge I'd give them about equal weight to folder names in the URL."

That should go without saying, but clearly MSN has not been doing this. Keywords in subdomain have been far more useful than keyword in folder. I believe they have recently lowered the discrpency a bit, which is a positive step, but more to the point they need to turn way, way, way, way down the value they put on keywords in any part of the URL. Yes, this can show relevance, but it has absolutely zero value as a signal of quality.

tictoc

4:43 pm on May 7, 2005 (gmt 0)

10+ Year Member Top Contributors Of The Month



I am certainly ready for the end of all subdomains that do not relate to the main domain of topic. I bet the engines will be looking at sub domain spam alot closer since the problem has gotten out of hand. I hope innocent sites are not hurt in the process though.