homepage Welcome to WebmasterWorld Guest from 50.16.36.153
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
  thread iconPages with Partially Syndicated Content
  No indexing of page elements
1jexx 3:51 pm on Jun 17, 2013 (gmt 0)
  thread iconFor all sitemap lines (URLs), can you just cut out the http://domain.
 
42kegx 5:29 pm on Jun 10, 2013 (gmt 0)
  thread iconSEO Content Related
 
2amitsachdeva 12:34 am on Jun 6, 2013 (gmt 0)
  thread iconI am confused about my sitemaps. What is best to do?
 
5virtualreality 5:07 pm on Jun 3, 2013 (gmt 0)
  thread iconWhat will happen to Yahoo urllist.txt now that their SE = Bing?
  urllist sitemap.xml yahoo bing webmaster tools
22kegx 8:16 pm on Jun 2, 2013 (gmt 0)
  thread iconWebsite verification.
  "y_key" still needed?
2Broadway 8:14 pm on Jun 2, 2013 (gmt 0)
  thread iconXML sitemaps encoded characters and GWT
  GWT reports 1 URL indexed from all sitemaps
3Fiver 9:13 pm on May 29, 2013 (gmt 0)
  thread iconxml sitemap parameters. are they required ?
 
9pkKumar 8:22 am on May 23, 2013 (gmt 0)
  thread iconPage Indexed but not Cached in Google
 
5Akshat_Rastogi 11:53 am on May 22, 2013 (gmt 0)
  thread iconRobots.txt strategy: allow only good, or disallow individual bad?
  Should my robots file say "Only google, yahoo, bing" or All are OK except.
4bigtoga 4:04 pm on May 13, 2013 (gmt 0)
  thread iconIf I changed my site description, could I ruin my spot at the top?
  #1 search result
2littlecubpanda 4:15 pm on May 9, 2013 (gmt 0)
  thread iconto map or not to map
 
1lucy24 10:30 pm on Apr 28, 2013 (gmt 0)
  thread iconXML Sitemap Generator for 1 million page site
  looking for a solution
5RichardV 4:59 pm on Apr 28, 2013 (gmt 0)
  thread iconSitemap.xml & Yoast sitemap-index.xml question
  A website and Wordpress Blog on same domain
5edwardsgs 3:45 pm on Apr 27, 2013 (gmt 0)
  thread iconPenalty for updating/adding sitemaps?
  Google is losing track of sitemap entries
6rstidx 7:18 pm on Apr 11, 2013 (gmt 0)
  thread iconHow do I block TagIDs?
 
6shaunm 6:40 am on Apr 11, 2013 (gmt 0)
  thread iconNOODP tag Question.
  Noodp
32kegx 7:54 pm on Apr 9, 2013 (gmt 0)
  thread iconRobots.txt Disallow Multiple Level Subdomains
  Can a parent subdomain's robots.txt disallow spiders in a deeper subdomain?
3rmjvol 9:02 pm on Apr 4, 2013 (gmt 0)
  thread iconWrong Lastmod Tag
 
3shaunm 11:05 am on Mar 27, 2013 (gmt 0)
  thread iconSite Titles not taken after 2 months, Descriptions Updated - help
  After robots.txt issues, google refuses to index Page title changes
3SilentiSonas 4:25 pm on Mar 25, 2013 (gmt 0)
  thread iconwhat is the User-Agent?
 
3lucy24 12:58 pm on Mar 24, 2013 (gmt 0)
  thread iconA huge number of URL's monitored on GWT
  Need to remove all of them
5morpheus83 4:41 am on Mar 20, 2013 (gmt 0)
  thread icontrafficbasedwtf
 
1lucy24 11:41 pm on Mar 4, 2013 (gmt 0)
  thread icongooglebot not get robots.txt
  robots.txt
5Luka2013 1:06 am on Mar 2, 2013 (gmt 0)
  thread iconWhy we use sitem.xml?
 
7levijoseph 10:35 am on Mar 1, 2013 (gmt 0)
Displaying Page 1 of 70 [ 1 ] 2 3 4 5 6 7 8 9 10 ... 70 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved