Forum Moderators: open

Message Too Old, No Replies

All your site in root?

Site structure.. how to exploit it

         

silverbytes

10:09 pm on Oct 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've noticed that my site has just one level deep and many of the documents in that folder are not crawled..
Those in root are.

I really don't like a site with all content on root, and it's kind of unordered, but it seems is the best way to
get crawled at least by google...

Any comments, experiences?
How can I encourage spiders to crawl inside

mysite.com/folder/mydocuments...

Before I move all documents to mysite.com/...

Thanks!

nakulgoyal

11:17 pm on Oct 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



silverbytes

It's not necessary that all your files are in the root to be indexed. PM me the URL and let me see why it was not indexed deep inside. There must be a reason!

Also, work on to get link popularity for your inner pages as well.

jdMorgan

12:52 am on Oct 10, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



silverbytes,

For search engine indexing, the directory structure and URL-path structure of your site do not matter -- at least they do not matter very much.

What matters is the length of the click-path from your pages which have good incoming links to those pages which you want to have indexed. How many clicks to get from your very popular pages to those that you want to get indexed -- that is what counts. Search engine spiders follow links, just like users do.

I believe the URL and directory structure of your site should be determined with maintainability and site security features (i.e. password-protected areas) in mind. Some small benefits can also be gained from keyword-in-URL techniques, but not enough to override the other two considerations.

Jim