Welcome to WebmasterWorld Guest from 3.93.74.227

Forum Moderators: mademetop

Message Too Old, No Replies

Site going live and I am having trouble with SEO issues.

Please advice is robot.txt will help me delay to rectify issues

     
8:32 pm on May 23, 2011 (gmt 0)

Full Member

10+ Year Member

joined:Nov 11, 2004
posts: 253
votes: 0


Hi,

I have a site that is going live very soon and cannot wait. It has a several parked pages that are doing well on the search engines.

Basically upon inspecting, all the pages are hidden in folders. Eg. cart/abc.php or html/abc.php
This absolutely makes no sense to the search engines and as you can see these are from a programmer's point of view. I would love to mod rewrite it but I would be a major task with the number of pages.

I am thinking of just robot.txt no follow the complete site and switch over live from the old main page to the new main page only (which would the gateway to access all the other pages that have been no follow indexed temporarily). That mean the only new content would be the new main page.

I really don't want all the mucked up page addresses to be indexed only to move them later.

Do you think there is any problem with this in the eyes of the search engines? I don't know enough to know if I am breaking any rules or if it is not ethical etc.

Please advice.
12:46 am on May 24, 2011 (gmt 0)

Moderator from AU 

WebmasterWorld Administrator anallawalla is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 3, 2003
posts:3773
votes: 21


all the pages are hidden in folders. Eg. cart/abc.php or html/abc.php


What do you mean by "hidden in folders"? There are numerous sites on the web with crazy URLs. I can see a problem if the content is hidden in a database and can only be retrieved after running a search *and* there is no browsable list of the products. I can also see a problem if the URLs have lots of slashes, but then again, I know well-indexed sites with as many as 14 slashes in the URLs. :( Google is good with long URLs now, but for a new site it is worth keeping them short and sweet.

Your mention of mod_rewrite suggests an Apache server. Have you visited our Apache forum [webmasterworld.com]? One of the prior discussions there might help.
1:00 am on May 24, 2011 (gmt 0)

Senior Member

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:July 3, 2002
posts:18903
votes: 0


There are several current threads about bulk redirection of old URLs, with code examples included, in the WebmasterWorld Apache forum.
1:43 pm on Sept 20, 2011 (gmt 0)

Junior Member

joined:Sept 10, 2011
posts:50
votes: 0


A nice sharing. Here is lot of tips to learn. Thanks everybody I got a great help from here.