Forum Moderators: goodroi

Message Too Old, No Replies

Robots Disallow Subfoler with *

Robots Disallow Subfoler with *

         

Tauqeeraziz

7:02 am on Oct 29, 2015 (gmt 0)

10+ Year Member



I have seen some of inner page of folder is Ranking improved which has been disallow with *
In Robots.txt is mention there below:

Disallow: /domain-names/*
Disallow: /vps-hosting/*

Please help me what the concept of * after slash.

Ranking with keywords "Linux VPS Hosting India" google.co.in SERP . website "hostocol.in"

tangor

8:04 am on Oct 29, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



robots.txt does not require * to terminate subfolders.

disallow /thisfolder/ will do the same thing.

lucy24

6:29 pm on Oct 29, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Please help me what the concept of *

Don't use * unless you have to. The minimalist robots.txt syntax is:

Disallow: /directoryname/
and-that's-all.

Anything more complicated, and you run the risk that your visiting robot will not understand it. So don't use constructions like wild cards except in sections dedicated to specific, named robots that you know will understand. (For example, the Googlebot understands "Allow" as well as the traditional "Disallow".)