Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- robots.txt - disallow any url containing.


BrainDed - 9:48 pm on May 18, 2011 (gmt 0)


Thanks again!

I changed my URL structure just last week, so 90% of those indexed pages are returning a 404 error.

I thought about doing a 301 redirect, but I dont think it would work. Here is what I am working with.

Structure was /messageboard/(forum number)/(topic number)
Strucure is messageboard/(forum NAME)/(topic NAME)

http://www.brewerscubs.com/messageboard/16/16417.html

http://www.brewerscubs.com/messageboard/mlb/astros-have-no-chance-in-winning-the-central-16417.html


The topic number in the URL is converted on the fly..



So the redirect would be:
redirect 301 /messageboard/(forum number)http://www.example.com/messageboard/(forum NAME)

But what about the change to the second part, the topic? No way could I create a redirect for every topic as there are thousands.

Would it be best for to add a disallow to the old urls, ignore it, or another route?

The site has been active for years, and I am just now paying attention to SEO. The pages in the board had no meta data at all prior to last week. Now the description is pulled from the text on the page and the title is the the topic title.


Thread source:: http://www.webmasterworld.com/robots_txt/4314267.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com