Forum Moderators: phranque
Can I make that almost all .php files (minus 2-3 ones) respond to /widget-keyword format? I know I can make all, but can I exclude, or give a different path to a few...?
Also, can I safely ban Google and other bots from indexing all .php files to void any dupe issues just in case? Keep in mind that the index page too is index.php, but I will not link to it; all links will be domain.com/
thanks for any suggestions,
/dir/
/dir/file.html
/dir/file.php
Google went through all of them and indexed only
/dir/file.php
What can you say about that! In my opinion as long as there are no parameters like in the query string any of the links above would've been indexed equaly.
If a consistent linking structure (exclusively absolute or exclusively relative) is one day accomplished, are some pages likely to fall out of the SE index due to duplicate content penalty?
You made one interesting observation : google probably stops indexing pages whose cotent is similar on the same site. Probably thay have few degrees of similarity which is why some pages are treated as different, other as 'similar pages' and others are just not indexed at all.
It this is true then I should start thinking to a tool to measure the 'distance' between pages of the same site which will ultimatelly affect the number of pages google will take into consideration.