homepage Welcome to WebmasterWorld Guest from 50.19.172.0
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconPages with Partially Syndicated Content
  No indexing of page elements
2jexx 4:59 pm on Jun 22, 2013 (gmt 0)
newpost thread iconFor all sitemap lines (URLs), can you just cut out the http://domain.
 
42kegx 5:29 pm on Jun 10, 2013 (gmt 0)
newpost thread iconWhat will happen to Yahoo urllist.txt now that their SE = Bing?
  urllist sitemap.xml yahoo bing webmaster tools
22kegx 8:16 pm on Jun 2, 2013 (gmt 0)
newpost thread iconWebsite verification.
  "y_key" still needed?
2Broadway 8:14 pm on Jun 2, 2013 (gmt 0)
newpost thread iconXML sitemaps encoded characters and GWT
  GWT reports 1 URL indexed from all sitemaps
3Fiver 9:13 pm on May 29, 2013 (gmt 0)
newpost thread iconxml sitemap parameters. are they required ?
 
9pkKumar 8:22 am on May 23, 2013 (gmt 0)
newpost thread iconPage Indexed but not Cached in Google
 
5Akshat_Rastogi 11:53 am on May 22, 2013 (gmt 0)
newpost thread iconRobots.txt strategy: allow only good, or disallow individual bad?
  Should my robots file say "Only google, yahoo, bing" or All are OK except.
4bigtoga 4:04 pm on May 13, 2013 (gmt 0)
newpost thread iconIf I changed my site description, could I ruin my spot at the top?
  #1 search result
2littlecubpanda 4:15 pm on May 9, 2013 (gmt 0)
newpost thread iconto map or not to map
 
1lucy24 10:30 pm on Apr 28, 2013 (gmt 0)
newpost thread iconXML Sitemap Generator for 1 million page site
  looking for a solution
5RichardV 4:59 pm on Apr 28, 2013 (gmt 0)
newpost thread iconSitemap.xml & Yoast sitemap-index.xml question
  A website and Wordpress Blog on same domain
5edwardsgs 3:45 pm on Apr 27, 2013 (gmt 0)
newpost thread iconPenalty for updating/adding sitemaps?
  Google is losing track of sitemap entries
6rstidx 7:18 pm on Apr 11, 2013 (gmt 0)
newpost thread iconHow do I block TagIDs?
 
6shaunm 6:40 am on Apr 11, 2013 (gmt 0)
newpost thread iconNOODP tag Question.
  Noodp
32kegx 7:54 pm on Apr 9, 2013 (gmt 0)
newpost thread iconRobots.txt Disallow Multiple Level Subdomains
  Can a parent subdomain's robots.txt disallow spiders in a deeper subdomain?
3rmjvol 9:02 pm on Apr 4, 2013 (gmt 0)
newpost thread iconWrong Lastmod Tag
 
3shaunm 11:05 am on Mar 27, 2013 (gmt 0)
newpost thread iconSite Titles not taken after 2 months, Descriptions Updated - help
  After robots.txt issues, google refuses to index Page title changes
3SilentiSonas 4:25 pm on Mar 25, 2013 (gmt 0)
newpost thread iconwhat is the User-Agent?
 
3lucy24 12:58 pm on Mar 24, 2013 (gmt 0)
newpost thread iconA huge number of URL's monitored on GWT
  Need to remove all of them
5morpheus83 4:41 am on Mar 20, 2013 (gmt 0)
newpost thread icontrafficbasedwtf
 
1lucy24 11:41 pm on Mar 4, 2013 (gmt 0)
newpost thread icongooglebot not get robots.txt
  robots.txt
5Luka2013 1:06 am on Mar 2, 2013 (gmt 0)
newpost thread iconWhy we use sitem.xml?
 
7levijoseph 10:35 am on Mar 1, 2013 (gmt 0)
newpost thread iconold Domain re-directed to New, Sitemap still getting read by old profi
 
2sikkiagarwal 10:22 am on Feb 8, 2013 (gmt 0)
newpost thread iconMultiple Websites block through Robots?
 
6Mansi_Padhya 7:14 pm on Jan 31, 2013 (gmt 0)
Displaying Page 3 of 72<< Back 1 2 [ 3 ] 4 5 6 7 8 9 10 11 12 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved