Welcome to WebmasterWorld Guest from 34.204.169.76

Forum Moderators: goodroi

Message Too Old, No Replies

Robots Disallow Subfoler with *

Robots Disallow Subfoler with *

     
7:02 am on Oct 29, 2015 (gmt 0)

New User

joined:Sept 24, 2015
posts: 2
votes: 0


I have seen some of inner page of folder is Ranking improved which has been disallow with *
In Robots.txt is mention there below:

Disallow: /domain-names/*
Disallow: /vps-hosting/*

Please help me what the concept of * after slash.

Ranking with keywords "Linux VPS Hosting India" google.co.in SERP . website "hostocol.in"
8:04 am on Oct 29, 2015 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member tangor is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 29, 2005
posts:10150
votes: 1014


robots.txt does not require * to terminate subfolders.

disallow /thisfolder/ will do the same thing.
6:29 pm on Oct 29, 2015 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:15766
votes: 831


Please help me what the concept of *

Don't use * unless you have to. The minimalist robots.txt syntax is:

Disallow: /directoryname/
and-that's-all.

Anything more complicated, and you run the risk that your visiting robot will not understand it. So don't use constructions like wild cards except in sections dedicated to specific, named robots that you know will understand. (For example, the Googlebot understands "Allow" as well as the traditional "Disallow".)
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members