Sitemaps, Meta Data, and robots.txt |
| Forum Charter, Library, Moderated by: goodroi | Forum Options: Reset Last Read Pointers |
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers. |
| | |
| new | Subject | Messages | Started by | Last Message |
 |  My page has never been indexed
| 2 | kknusa | 6:45 am on Jan 23, 2004 (gmt 0) |
|
| Subdomains
| 2 | BBB_Guy | 6:38 am on Jan 23, 2004 (gmt 0) |
|
| Indexed pages that are disalowed by robots.txt
is this normal? | 10 | WebJoe | 7:03 pm on Jan 20, 2004 (gmt 0) |
|
| Google ignoring robots.txt
No real surprise, but a real pain | 9 | voice220 | 4:12 pm on Jan 19, 2004 (gmt 0) |
|
| Is there any bots to block?
Else than the infamous "Web Content International"? | 3 | Daemon | 11:56 pm on Jan 16, 2004 (gmt 0) |
|
| Robots.txt help
| 5 | mikemcs | 1:04 pm on Jan 16, 2004 (gmt 0) |
|
| Who are these spiders and what do they want?
| 7 | obsos | 4:51 pm on Jan 14, 2004 (gmt 0) |
|
| Revisit instruction for robots
I want to specify different revisit instruction different sections | 3 | adityamodi | 5:13 am on Jan 10, 2004 (gmt 0) |
|
| Have I been blocking Altavista spider from spidering my site?
| 6 | irock | 6:10 pm on Jan 9, 2004 (gmt 0) |
|
| robot.txt to remove an alias
Afraid of duplicated content | 2 | Ulkari | 5:48 pm on Jan 8, 2004 (gmt 0) |
|
| Spider Names
I need the names of some SEs usernames | 3 | The_Young_One | 2:47 am on Jan 8, 2004 (gmt 0) |
|
| Blocking Includes (SSI)
blocking ssi | 3 | direktor1 | 4:03 pm on Jan 7, 2004 (gmt 0) |
|
| Subdomains
How to exclude | 4 | gosman | 2:54 pm on Jan 6, 2004 (gmt 0) |
|
| Does the leading / make any difference?
Sorry, I'm new to robots.txt | 2 | AsleepATheWheel | 1:07 am on Jan 6, 2004 (gmt 0) |
|
| faulty robots.txt?
| 5 | tenaka | 2:13 pm on Jan 3, 2004 (gmt 0) |
|
| Only those on the list are allowed entrance
All others OUT | 7 | grnidone | 5:29 pm on Jan 2, 2004 (gmt 0) |
|
| txt text for website
txt | 4 | krikri | 5:11 pm on Jan 2, 2004 (gmt 0) |
|
| Check my robots.txt please
Don't want to block adsense bot | 3 | conroy | 2:10 pm on Jan 2, 2004 (gmt 0) |
|
| How to ban YahooSeeker?
Used robots file, but it doesn't obey. | 2 | zf007 | 3:59 am on Jan 1, 2004 (gmt 0) |
|
| deny a spider from visiting a single page
| 3 | Michael_Weir | 3:08 pm on Dec 29, 2003 (gmt 0) |
|
| Disallow indexing on dynamic files
Disallow indexing on dynamic files | 6 | premzero | 2:58 am on Dec 26, 2003 (gmt 0) |
|
| banning "vscooter" but allowing "scooter"
| 4 | keyplyr | 9:15 pm on Dec 25, 2003 (gmt 0) |
|
| robots.txt not showing...
| 4 | mubarak_zeb | 3:37 pm on Dec 19, 2003 (gmt 0) |
|
| Getting 403 Forbidden for robots.txt
Can anyone help | 11 | GodLikeLotus | 4:59 am on Dec 18, 2003 (gmt 0) |
|
| robots.txt use and hosting provider problem
robots.txt use and hosting provider problem | 2 | david_cool | 6:55 pm on Dec 16, 2003 (gmt 0) |
| Displaying Page 61 of 70 | << Back 1 ... 51 52 53 54 55 56 57 58 59 60 [ 61 ] 62 63 64 65 66 67 68 69 70 Next >> |
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved
