homepage Welcome to WebmasterWorld Guest from 54.204.141.129
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconProtecting robots.txt file from bad guys
  Is it enough to passwoed protect those dirs?
3damlag 4:10 pm on Nov 21, 2004 (gmt 0)
newpost thread iconHow to Exclude from Yahoo/MSN results!
  I want to exclude underconstruction site
2fm101 1:49 am on Nov 21, 2004 (gmt 0)
newpost thread iconHow to block all subdirectories?
 
2TerryMc 7:05 pm on Nov 17, 2004 (gmt 0)
newpost thread iconHow to exclude dynamic URLS?
  So Search engines dont get bogged down.
7Tech2004 4:54 am on Nov 16, 2004 (gmt 0)
newpost thread iconEffect of Robots.txt
 
5seolancer 5:31 am on Nov 15, 2004 (gmt 0)
newpost thread iconrobots.txt - newbie needs help
 
5geezer_uk 5:39 am on Nov 10, 2004 (gmt 0)
newpost thread iconexcluding cgi-bin
  is this right
2rbacal 2:59 am on Nov 10, 2004 (gmt 0)
newpost thread iconIs robot.txt a must for good SEO?
  --whats the purpose of robot.txt
4redleaf 12:24 am on Nov 9, 2004 (gmt 0)
newpost thread iconWeird 404 error hitting on robot.txt
  anyone experienced this before?
3redleaf 9:30 am on Nov 8, 2004 (gmt 0)
newpost thread iconrobots.txt and free web hosting
 
3rhodopsin 7:46 am on Nov 8, 2004 (gmt 0)
newpost thread iconPossible to have a page disalowed by robots.txt but indexed by adsense
  Possible to do this?
2brakkar 9:16 pm on Nov 5, 2004 (gmt 0)
newpost thread iconProtocol interpretation
  Peerbot or I misunderstood the robot exclusion protocol
3WebJoe 9:11 pm on Nov 5, 2004 (gmt 0)
newpost thread iconNeed help about File Robots.txt
  how do I know spiders visit to my site or not?
3viva 10:15 am on Nov 4, 2004 (gmt 0)
newpost thread iconwhat happen with robot exclusion and iframes?
  could it be a problem to exclude content that appears inside a home iframe?
2mgorricho 5:03 pm on Nov 3, 2004 (gmt 0)
newpost thread iconprotocol extension resource control
  proposed extension to robots.txt protocol allowing resource control
1copsewood 11:29 am on Nov 2, 2004 (gmt 0)
newpost thread iconQuerystring check
 
2papamaku 9:36 am on Nov 2, 2004 (gmt 0)
newpost thread iconrobots and nav bars
  excluding links in nav bars ...
2f00fighter 11:38 pm on Oct 29, 2004 (gmt 0)
newpost thread iconNeed assistance with robot controls
  need help with a robot .txt file
2borkboing 11:31 pm on Oct 29, 2004 (gmt 0)
newpost thread iconRobots.txt not working
  bots not obeying robots.txt
4cyberjunkie 11:05 pm on Oct 29, 2004 (gmt 0)
newpost thread iconUse .htaccess to serve correct robots.txt?
  Using htaccess and robots.txt to elimiate file duplication and 404 errors
2iceman 12:05 am on Oct 26, 2004 (gmt 0)
newpost thread iconRobots detection tool?
 
2obsos 1:17 am on Oct 25, 2004 (gmt 0)
newpost thread iconrobots.txt vs index,follow
  Who will win?
3brakkar 6:13 pm on Oct 24, 2004 (gmt 0)
newpost thread iconRemoved 'deny all' robots.txt but no change
 
2kapow 11:03 pm on Oct 23, 2004 (gmt 0)
newpost thread iconWhat name does msn's spider use?
  Lots of visits from yahoo and google....but not msn
2David_Bruning 7:05 am on Oct 19, 2004 (gmt 0)
newpost thread iconRobots.txt? (removing a specific subdirectory from google index...)
 
3hugo_guzman 8:06 pm on Oct 18, 2004 (gmt 0)
Displaying Page 53 of 71<< Back 1 ... 43 44 45 46 47 48 49 50 51 52 [ 53 ] 54 55 56 57 58 59 60 61 62 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved