homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / WebmasterWorld / New To Web Development
Forum Library, Charter, Moderators: brotherhood of lan & mack

New To Web Development Forum

What is "robots.txt" and "sitemap" -- do I need this stuff?
What the HECK is it?

Msg#: 4572308 posted 1:07 pm on May 9, 2013 (gmt 0)

I use Godaddy web site builder so I have no idea how to install these things or whether I need them, or what the heck they even are (does Godaddy preinstall them)?

Google webmaster tools says sitemap is not even there (my sites only have one or two pages, is it necessary?).

I wish this stuff was more easily explained.



WebmasterWorld Senior Member 5+ Year Member

Msg#: 4572308 posted 1:30 pm on May 9, 2013 (gmt 0)

i wouldnt worry about the sitemap. they are basically just a big list of all the pages in your site, to help search engines find them better. if you've only got 2 pages in the whole site then there's no point.

the robots page is basically a file which tells search engines to keep out of certain directories and away from certain pages, if you dont want them to appear in their search indexes. you can also use it to keep troublesome search bots away from your entire site. but if you want both pages of your site indexed, then you can forget about it.


WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month

Msg#: 4572308 posted 7:38 pm on May 9, 2013 (gmt 0)

I wish this stuff was more easily explained.

More easily than what? robotstxt dot org spells it out, piece by piece.

:: shuffling papers ::

Yup, thought I remembered right. Your first post-- from a whopping two days ago-- said
I am the absolute amateur of amateurs.

I have NO IDEA what's going on.
I have no idea what CSS is, SSL, Flash

You're not expecting to sit back and let the money rain down, are you?

otoh you seem to have found WebmasterWorld within days. It took me several years.

:: vague mental association with deathless quote from Jean Chretien ::

Global Options:
 top home search open messages active posts  

Home / Forums Index / WebmasterWorld / New To Web Development
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved