Forum Moderators: goodroi
After I changed the code to the following every page became visable to the tool (no "Error: 403 Forbidden by robots.txt" returned):
User-agent: *
Disallow: /private
Disallow: /cgi-bin
Disallow: /scgi-bin
Disallow: /cpanel-upgrade
User-Agent: sitecheck.internetseer.com
Disallow: /
User-Agent: NPBot-1/2.0
Disallow: /
User-agent: linksmanager
Disallow: /
User-agent: Cyveillance
Disallow: /
My questions are:
1. Is it possible that because of this my rankings have been affected for the last three years?
2. Is this a bug in the actual tool? All pages on my site are indexed.
ANY COMMENTS?
robots.txt file that I used for 3 years:
User-agent: *
Disallow: /private
Disallow: /cgi-bin
Disallow: /scgi-bin
Disallow: /cpanel-upgrade
User-Agent: sitecheck.internetseer.com
Disallow: /
User-Agent: NPBot-1/2.0
Disallow: /
User-agent: linksmanager
Disallow: /
User-agent: Cyveillance
Disallow: /
After I changed the code to the following every page became visable to the tool (no "Error: 403 Forbidden by robots.txt" returned):
User-agent: *
Disallow: /private
Disallow: /cgi-bin
Disallow: /scgi-bin
Disallow: /cpanel-upgrade
User-Agent: sitecheck.internetseer.com
Disallow: /
User-Agent: NPBot-1/2.0
Disallow: /
User-agent: linksmanager
Disallow: /
User-agent: Cyveillance
Disallow: /
The only change is a blanc line inserted after "Disallow: /cpanel-upgrade"
My questions are:
1. Is it possible that because of this my rankings have been affected for the last three years?
2. Is this a bug in the actual tool? All pages on my site are indexed.
ANY COMMENTS?