homepage Welcome to WebmasterWorld Guest from 54.144.197.140
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconIs there a way to do this?
  inverted robots
3Steviebone 2:33 pm on Mar 4, 2015 (gmt 0)
newpost thread iconWeird, compounded URLs in webmaster tools
  ..and how can I stop this?
14olamcbola 3:49 am on Mar 4, 2015 (gmt 0)
newpost thread iconwhy google result does not show full url?
  why google result does not show full url?
4apprich 8:01 pm on Feb 20, 2015 (gmt 0)
newpost thread iconNo CSS in Google Cache
  No CSS in Google cache version of my page
2promeera 5:12 pm on Feb 12, 2015 (gmt 0)
newpost thread iconShould XML sitemap ONLY include actual URLs (not sort variants, etc)?
  XML sitemaps and sort variants
2domino66 5:05 pm on Feb 9, 2015 (gmt 0)
newpost thread iconHow to handle meta desciption for ecommerce site product pages?
  Will duplicate meta desciption in ecommerce site product pages affect rank?
2imshazia 3:06 pm on Jan 28, 2015 (gmt 0)
newpost thread iconDoes the Google indexing of URLs with filter parameters bad for SEO?
  Thousands of website URLs with filter parameters indexed in Google.
6imshazia 7:20 am on Jan 28, 2015 (gmt 0)
newpost thread iconHow to find pages not indexed by Google
 
7cosmonaut 9:10 am on Jan 10, 2015 (gmt 0)
newpost thread iconT&C , Privacy policy .pages
  Should I no-index privacy policy and T&C pages?
5Patchulee 4:01 pm on Dec 31, 2014 (gmt 0)
newpost thread iconBad Bot Blackhole - More Effective Than I Anticipated
  Have some questions about the results...
3SerpsGuy 7:10 am on Dec 19, 2014 (gmt 0)
newpost thread iconrobots.txt block all deeper URLs in subfolder but not root
 
7Adam_C 11:31 am on Dec 9, 2014 (gmt 0)
newpost thread iconHow to make HTTPS page crawlable and cacheble instead of HTTP page?
  To resolve my home page's caching problem.
3vicky1987 6:59 am on Dec 8, 2014 (gmt 0)
newpost thread iconMeta description
 
4webtechnocrazy 7:22 am on Nov 26, 2014 (gmt 0)
newpost thread iconMultiple XML sitemap generator?
 
2Metzed 11:34 pm on Nov 14, 2014 (gmt 0)
newpost thread iconIssue: Url blocked by robots.txt.
  Cause?
5aherman 10:30 am on Nov 3, 2014 (gmt 0)
newpost thread iconGoogle Publishes Best Practices for XML Sitemaps and RSS and Atom Feeds
 
1engine 4:22 pm on Oct 16, 2014 (gmt 0)
newpost thread iconHow to stop google from indexing feeds
  google indexing feeds
5bearbrick 10:15 am on Oct 11, 2014 (gmt 0)
newpost thread iconHow to stop Google from indexing a page?
  I need to block the following page alone from Google Index:
8sathishvaiha 10:01 pm on Oct 9, 2014 (gmt 0)
newpost thread iconDiscrepancy with amount of pages indexed
 
6freshpaul 5:11 pm on Oct 9, 2014 (gmt 0)
newpost thread iconForce the spider to not index pages
 
4cfmtravel 7:13 pm on Sep 6, 2014 (gmt 0)
newpost thread iconRobots.txt: Disallow everything except these pages
 
7ron_ron 3:30 pm on Sep 4, 2014 (gmt 0)
newpost thread iconNo cache meta tags
  Does it help Google get back and reindex faster?
3kokopoko 10:11 pm on Aug 23, 2014 (gmt 0)
newpost thread iconmaking a spider handle rel canonical
 
2cpollett 8:30 pm on Aug 23, 2014 (gmt 0)
newpost thread iconShould I use SEO company to build sitemap or do it myself?
 
11born2run 6:00 am on Jul 24, 2014 (gmt 0)
newpost thread iconsitemap priority field
 
3roshaoar 4:39 am on Jun 21, 2014 (gmt 0)
Displaying Page 1 of 72 [ 1 ] 2 3 4 5 6 7 8 9 10 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved