Welcome to WebmasterWorld Guest from 54.145.136.73

Forum Moderators: goodroi

Redireted URls showing up in Robots.txt Errors

   
8:55 pm on Apr 1, 2011 (gmt 0)

5+ Year Member



Hi,

Their is no single url I am restricting in robots.txt file but still in GWT it showing around 1800 URLS restricted by robots.txt.

The common thing observed in these urls are all redirected to different site (because it is coupons site).


If any threads already exists for this issue please let me know.


Thanks in Advance
10:58 am on Apr 2, 2011 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Is your robots.txt file blank?

How are you redirecting to the different sites?
8:58 am on Apr 13, 2011 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



Does the second site also belong to you? If so, what does its robots.txt say? Are they 301 redirects? If so, I'm pretty sure gwt is giving you the information that applies to the new location, not the original one, so that's where you need to investigate.
 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month