Forum Moderators: phranque

Message Too Old, No Replies

Strategies for organizing source files on server?

And what to hide from robots?

         

kiril

1:12 am on Aug 14, 2003 (gmt 0)

10+ Year Member



I'm close to uploading a new website that I've been designing. This is my first time around, and I'm wondering about two things:

a) Is there any reason I shouldn't divide things up among subdirectories on the server, e.g. images in one place, temporary html files in another, major html pages in the root, etc. This will keep things organized, but I'd like to know if there are drawbacks.

b) What is commonly hidden from the robots using the robots.txt file? Is there any point in hiding a lot of stuff (apart from the important html content pages, of course)? What I have in mind is that it might make it easier for search engine robots to find the important stuff if a lot extraneous subdirectories are hidden.

Thanks.

Slade

2:13 am on Aug 14, 2003 (gmt 0)

10+ Year Member



a) The only ramification to directory layout is maintainability. Link structure determines what pages are found, not directory structure. I keep my images seperate from content(personal preference), even though I have very few images. Whatever you set up, you'll be stuck with, so make sure you like it. (Yes, you can move pages around later, but why mess up everyone's bookmarks?)

b) Blocking particular directories *could* make others more likely to be read, but only because of the law of averages, and the intuitiveness of the robot to reading your linking structure. (Open to thoughts to the contrary.)