homepage Welcome to WebmasterWorld Guest from 54.243.12.156
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Website
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconrobots.txt - newbie needs help
 
5geezer_uk 5:39 am on Nov 10, 2004 (gmt 0)
newpost thread iconexcluding cgi-bin
  is this right
2rbacal 2:59 am on Nov 10, 2004 (gmt 0)
newpost thread iconIs robot.txt a must for good SEO?
  --whats the purpose of robot.txt
4redleaf 12:24 am on Nov 9, 2004 (gmt 0)
newpost thread iconWeird 404 error hitting on robot.txt
  anyone experienced this before?
3redleaf 9:30 am on Nov 8, 2004 (gmt 0)
newpost thread iconrobots.txt and free web hosting
 
3rhodopsin 7:46 am on Nov 8, 2004 (gmt 0)
newpost thread iconPossible to have a page disalowed by robots.txt but indexed by adsense
  Possible to do this?
2brakkar 9:16 pm on Nov 5, 2004 (gmt 0)
newpost thread iconProtocol interpretation
  Peerbot or I misunderstood the robot exclusion protocol
3WebJoe 9:11 pm on Nov 5, 2004 (gmt 0)
newpost thread iconNeed help about File Robots.txt
  how do I know spiders visit to my site or not?
3viva 10:15 am on Nov 4, 2004 (gmt 0)
newpost thread iconwhat happen with robot exclusion and iframes?
  could it be a problem to exclude content that appears inside a home iframe?
2mgorricho 5:03 pm on Nov 3, 2004 (gmt 0)
newpost thread iconprotocol extension resource control
  proposed extension to robots.txt protocol allowing resource control
1copsewood 11:29 am on Nov 2, 2004 (gmt 0)
newpost thread iconQuerystring check
 
2papamaku 9:36 am on Nov 2, 2004 (gmt 0)
newpost thread iconrobots and nav bars
  excluding links in nav bars ...
2f00fighter 11:38 pm on Oct 29, 2004 (gmt 0)
newpost thread iconNeed assistance with robot controls
  need help with a robot .txt file
2borkboing 11:31 pm on Oct 29, 2004 (gmt 0)
newpost thread iconRobots.txt not working
  bots not obeying robots.txt
4cyberjunkie 11:05 pm on Oct 29, 2004 (gmt 0)
newpost thread iconUse .htaccess to serve correct robots.txt?
  Using htaccess and robots.txt to elimiate file duplication and 404 errors
2iceman 12:05 am on Oct 26, 2004 (gmt 0)
newpost thread iconRobots detection tool?
 
2obsos 1:17 am on Oct 25, 2004 (gmt 0)
newpost thread iconrobots.txt vs index,follow
  Who will win?
3brakkar 6:13 pm on Oct 24, 2004 (gmt 0)
newpost thread iconRemoved 'deny all' robots.txt but no change
 
2kapow 11:03 pm on Oct 23, 2004 (gmt 0)
newpost thread iconWhat name does msn's spider use?
  Lots of visits from yahoo and google....but not msn
2David_Bruning 7:05 am on Oct 19, 2004 (gmt 0)
newpost thread iconRobots.txt? (removing a specific subdirectory from google index...)
 
3hugo_guzman 8:06 pm on Oct 18, 2004 (gmt 0)
newpost thread iconMore help in robots.txt
  robots.txt
2sakuramy 1:25 pm on Oct 18, 2004 (gmt 0)
newpost thread iconrobots.txt validator
  Error, Error, Error loads of them
7hatap 12:45 pm on Oct 18, 2004 (gmt 0)
newpost thread iconAllowing some bots, disallowing all others
 
2xbase234 5:16 pm on Oct 16, 2004 (gmt 0)
newpost thread iconRobot Help
 
5Stra 4:41 pm on Oct 16, 2004 (gmt 0)
newpost thread iconStop image bot from indexing my images
 
2ladyluck 1:17 pm on Oct 14, 2004 (gmt 0)
Displaying Page 53 of 71<< Back 1 ... 43 44 45 46 47 48 49 50 51 52 [ 53 ] 54 55 56 57 58 59 60 61 62 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved