homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

What does "root of domain" mean & what is 404 error?
root of domain 404 error

10+ Year Member

Msg#: 352 posted 7:53 am on Mar 31, 2004 (gmt 0)

I have just created my first website using Dreamweaver and am completly new to everything. So here are my newbie questions...

Someone stated that the robot.txt should be in the root of the domain. What is the root of the domain?

Here's what I did...I created my website, then created a blank text page with the url www.mydomain.com/robot.txt. Then I uploaded the entire site. However, the robot url doesn't link in anyway to my site, is this correct?

When I tried to validate my url, it said 404 not found. What does this mean?

Thanks so much for your help!



10+ Year Member

Msg#: 352 posted 8:14 am on Mar 31, 2004 (gmt 0)

When you create a site in DW, if you do not correctly define the site with its local folder and folder (if any) on your server space, you can get what you see now.

There is a section in the DW help files "Defining a Site" which should take you through this.

The biggest variable for you is whether you need to define a folder in your site access details or if you will be loading straight to the "ROOT" within the folder where your html files will reside.

What can be a revelation is to define the site with an empty local folder called "site" for example. Then download the basic site structure from the server. This will put the site folder structure into your "Local Folder" as defined in DW. You will then probable see a "public_html" folder or something similar.

That is where you put your site and then upload. This holds for all your basic pages and images. CGI and other clever bits may reside outside this "public_html" folder.

To do this, you will need to delete what you have uploaded so far. Make sure you don't delete anything that was there before you uploaded your site.

To answer one of your questions the "Root" is the level where your index.html or home.html will reside. The contents any folders such as images etc. will be residing 1 level below the "Root".

Yes your robots.txt should reside on the "Root" and should have no links to it.
If you enter www.mydomain.com/robot.txt into your browser, the contents of your robots.txt file should display.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved