Sitemaps, Meta Data, and robots.txt |
| Forum Charter, Library, Moderated by: goodroi | Forum Options: Reset Last Read Pointers |
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers. |
| | |
| new | Subject | Messages | Started by | Last Message |
 |  Can i add robot txt to a free hosting site? keywords
| 2 | alze | 5:14 am on Oct 3, 2004 (gmt 0) |
|
| Does robots.txt prevent all access?
...on page as well as directory. | 2 | yump | 5:02 am on Oct 3, 2004 (gmt 0) |
|
| Robots.txt sabotage
Common? How to protect? | 4 | adfree | 11:05 am on Sep 30, 2004 (gmt 0) |
|
| newbie to robots.txt, want to exclude /images/
excluding some image folders but not others | 2 | franco81 | 3:29 am on Sep 30, 2004 (gmt 0) |
|
| Newbie - Why wouldn't I want to allow certain robots?
If I don't have anything on the site I want to keep private | 4 | AmyG | 4:03 pm on Sep 29, 2004 (gmt 0) |
|
| What if your domains robots.txt
Was pointed to your domain? | 5 | Daily_Sparring | 3:22 am on Sep 27, 2004 (gmt 0) |
|
| Where to put robots in website?
I has doubt where to put robots. | 3 | viva | 10:00 am on Sep 26, 2004 (gmt 0) |
|
| robots.txt and .htaccess
| 1 | HuhuFruFru | 12:02 am on Sep 26, 2004 (gmt 0) |
|
| Excluding Sub Folders
When you exclude a folder, are folders inside that excluded also? | 3 | damlag | 8:39 pm on Sep 25, 2004 (gmt 0) |
|
| Can someone help me write a robots.txt?
| 5 | budbiss | 11:50 pm on Sep 19, 2004 (gmt 0) |
|
| www.example.com/view.php
How to avoid spidering of anything with this prefix | 2 | nuevojefe | 10:26 pm on Sep 19, 2004 (gmt 0) |
|
| robots.txt
Invalid warnings | 5 | wolfline | 5:10 am on Sep 17, 2004 (gmt 0) |
|
| possible sabotage?
robot.txt working against me? | 5 | seofan | 9:36 pm on Sep 8, 2004 (gmt 0) |
|
| who can give me a website log file sample to see?
website log file | 3 | Tellist | 5:19 pm on Sep 4, 2004 (gmt 0) |
|
| Google CHTML Proxy disobeying robots.txt
Why? | 5 | yosmc | 12:16 pm on Aug 31, 2004 (gmt 0) |
|
| Google tells me to change my robots.txt
Should I follow the advice from Google adSense? | 2 | Bonusbana | 2:44 pm on Aug 27, 2004 (gmt 0) |
|
| Master List of Malicious Robots
Is there an active list of the bots we should block? | 5 | Eric_Lander | 4:09 pm on Aug 25, 2004 (gmt 0) |
|
| robots.txt security problems?
| 2 | helohelo | 3:44 pm on Aug 25, 2004 (gmt 0) |
|
| 301 Redirect domain?
How to handle robots.txt? | 5 | Mr_Roberto | 1:13 am on Aug 24, 2004 (gmt 0) |
|
| Creating robots.txt file.
| 6 | kabanero | 8:34 pm on Aug 18, 2004 (gmt 0) |
|
| Blocking just one parameter via robots.txt
Is this even possible? | 2 | werty | 7:31 pm on Aug 18, 2004 (gmt 0) |
|
| Problem with spiderbots scrounging for robot.txt
| 3 | Mr_N | 6:49 am on Aug 10, 2004 (gmt 0) |
|
| i have a subdomain I dont want indexed
is robots.txt the answer? | 4 | chrisandsarah | 1:21 pm on Aug 8, 2004 (gmt 0) |
|
| robots.txt appearing in my log files
But I have n't got one there! | 5 | uk_webber | 2:59 pm on Aug 5, 2004 (gmt 0) |
|
| To Robots.txt or not
Do we use both? | 4 | obsos | 11:20 pm on Aug 1, 2004 (gmt 0) |
| Displaying Page 53 of 70 | << Back 1 ... 43 44 45 46 47 48 49 50 51 52 [ 53 ] 54 55 56 57 58 59 60 61 62 ... 70 Next >> |
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved
