Welcome to WebmasterWorld Guest from

Forum Moderators: brotherhood of lan & mack

Message Too Old, No Replies

What is "robots.txt" and "sitemap" -- do I need this stuff?

What the HECK is it?

1:07 pm on May 9, 2013 (gmt 0)

Preferred Member

joined:May 7, 2013
votes: 0

I use Godaddy web site builder so I have no idea how to install these things or whether I need them, or what the heck they even are (does Godaddy preinstall them)?

Google webmaster tools says sitemap is not even there (my sites only have one or two pages, is it necessary?).

I wish this stuff was more easily explained.
1:30 pm on May 9, 2013 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 12, 2006
votes: 22

i wouldnt worry about the sitemap. they are basically just a big list of all the pages in your site, to help search engines find them better. if you've only got 2 pages in the whole site then there's no point.

the robots page is basically a file which tells search engines to keep out of certain directories and away from certain pages, if you dont want them to appear in their search indexes. you can also use it to keep troublesome search bots away from your entire site. but if you want both pages of your site indexed, then you can forget about it.
7:38 pm on May 9, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month

joined:Apr 9, 2011
votes: 244

I wish this stuff was more easily explained.

More easily than what? robotstxt dot org spells it out, piece by piece.

:: shuffling papers ::

Yup, thought I remembered right. Your first post-- from a whopping two days ago-- said
I am the absolute amateur of amateurs.

I have NO IDEA what's going on.
I have no idea what CSS is, SSL, Flash

You're not expecting to sit back and let the money rain down, are you?

otoh you seem to have found WebmasterWorld within days. It took me several years.

:: vague mental association with deathless quote from Jean Chretien ::

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members