Welcome to WebmasterWorld Guest from 174.129.151.95

Forum Moderators: goodroi

Message Too Old, No Replies

Redireted URls showing up in Robots.txt Errors

   
8:55 pm on Apr 1, 2011 (gmt 0)

5+ Year Member



Hi,

Their is no single url I am restricting in robots.txt file but still in GWT it showing around 1800 URLS restricted by robots.txt.

The common thing observed in these urls are all redirected to different site (because it is coupons site).


If any threads already exists for this issue please let me know.


Thanks in Advance
10:58 am on Apr 2, 2011 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Is your robots.txt file blank?

How are you redirecting to the different sites?
8:58 am on Apr 13, 2011 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



Does the second site also belong to you? If so, what does its robots.txt say? Are they 301 redirects? If so, I'm pretty sure gwt is giving you the information that applies to the new location, not the original one, so that's where you need to investigate.