| Welcome to WebmasterWorld Guest from 126.96.36.199 |
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
|Subscribe to WebmasterWorld|
|Blocking Partial Contents of Folder Without Using Robots Tag|
10 files (7 want indexed, 3 want blocked)
| 9:47 am on Mar 23, 2007 (gmt 0)|
System: The following message was cut out of thread at: http://www.webmasterworld.com/robots_txt/3274413.htm [webmasterworld.com] by goodroi - 6:24 am on Mar. 23, 2007 (utc -5)
Can you please help me out. I have 10 files contained in a folder. I want to crawl 7 files and dont want index remaining 3 files.
- I guess it will not index all the files contained in this folder.
I only want to do this through robots.txt files not with robots meta tags.
I am looking for your replies friends.
Thanks in advance,
| 10:16 am on Mar 27, 2007 (gmt 0)|
Should I guess that no one is capable to give me the answer of my query?
| 2:05 pm on Mar 27, 2007 (gmt 0)|
SandySEO, with a name like that, why are you asking us? Simple, basic, beginner stuff for an SEO expert.
Block each file by name that you wanted blocked in the robots.txt.
Back to Lurking
| 7:53 pm on Mar 27, 2007 (gmt 0)|
|I only want to do this through robots.txt files not with robots meta tags. |
Robots.txt was built to block entire directories and not individual files. I would suggest you rethink about using robots meta tags.
| 8:49 pm on Mar 27, 2007 (gmt 0)|
[edited by: Key_Master at 8:51 pm (utc) on Mar. 27, 2007]
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
© Webmaster World 1996-2014 all rights reserved