Welcome to WebmasterWorld Guest from

Forum Moderators: brotherhood of lan & mack

Message Too Old, No Replies

What is "robots.txt" and "sitemap" -- do I need this stuff?

What the HECK is it?



1:07 pm on May 9, 2013 (gmt 0)

I use Godaddy web site builder so I have no idea how to install these things or whether I need them, or what the heck they even are (does Godaddy preinstall them)?

Google webmaster tools says sitemap is not even there (my sites only have one or two pages, is it necessary?).

I wish this stuff was more easily explained.


1:30 pm on May 9, 2013 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member

i wouldnt worry about the sitemap. they are basically just a big list of all the pages in your site, to help search engines find them better. if you've only got 2 pages in the whole site then there's no point.

the robots page is basically a file which tells search engines to keep out of certain directories and away from certain pages, if you dont want them to appear in their search indexes. you can also use it to keep troublesome search bots away from your entire site. but if you want both pages of your site indexed, then you can forget about it.


7:38 pm on May 9, 2013 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month

I wish this stuff was more easily explained.

More easily than what? robotstxt dot org spells it out, piece by piece.

:: shuffling papers ::

Yup, thought I remembered right. Your first post-- from a whopping two days ago-- said
I am the absolute amateur of amateurs.

I have NO IDEA what's going on.
I have no idea what CSS is, SSL, Flash

You're not expecting to sit back and let the money rain down, are you?

otoh you seem to have found WebmasterWorld within days. It took me several years.

:: vague mental association with deathless quote from Jean Chretien ::

Featured Threads

Hot Threads This Week

Hot Threads This Month