Welcome to WebmasterWorld Guest from 18.104.22.168 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe and Support WebmasterWorld
Redireted URls showing up in Robots.txt Errors raj1094 msg:4290970 8:55 pm on Apr 1, 2011 (gmt 0) Hi, Their is no single url I am restricting in robots.txt file but still in GWT it showing around 1800 URLS restricted by robots.txt. The common thing observed in these urls are all redirected to different site (because it is coupons site). If any threads already exists for this issue please let me know. Thanks in Advance
goodroi msg:4291173 10:58 am on Apr 2, 2011 (gmt 0)
Is your robots.txt file blank? How are you redirecting to the different sites? lucy24 msg:4296739 8:58 am on Apr 13, 2011 (gmt 0)
Does the second site also belong to you? If so, what does its robots.txt say? Are they 301 redirects? If so, I'm pretty sure gwt is giving you the information that applies to the new location, not the original one, so that's where you need to investigate.