Forum Moderators: open

Message Too Old, No Replies

How to get crawlers to index my whole site

         

Anyango

7:49 pm on Jun 16, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hello All

lets say i have a website

http://www.example.com

and "public_html" is the root folder for this domain right. that folder contains lets say 1,000 pages which belong to my website BUT only and only the index.hml was linked on any other website or only index.html was known to outside world untill anyone loads my website.

Now will the Bots study all my pages in that directory or they will just spider those pages which they came in for? if i "Allow" all user agents for that directory.

My question in simple words is

I want bots to read each and every file of my root directory, no matter if thats linked or not. what should i do for that

Many Thanks for giving your time to help me.
Kami

[edited by: engine at 7:52 pm (utc) on June 16, 2005]
[edit reason] examplified [/edit]

sem4u

12:13 pm on Jun 17, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



How do you expect the bots to find your files if they are not linked to your website? Search engine robots crawl the web for information. If files are not linked they are unlikely to be found.

shtirlitz

9:55 pm on Jun 22, 2005 (gmt 0)



It is very simple.

You just need to get some backlinks from other site.

The simplest solution is to go to different forums
and post in "Site Reviews" section, asking to review your site.

[edited by: Woz at 10:38 pm (utc) on June 22, 2005]
[edit reason] No Sigs please, see TOS#13 [/edit]