Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

G Webmaster Tools - Not Found URL on Test Domain

         

Propools

8:25 pm on Dec 10, 2008 (gmt 0)

10+ Year Member



I've finally gotten everything cleaned up according to Dec. 9th Reporting on Google Webmaster Tools but 1 URL Not Found.

Oddly enough it's "www.ourdomain.cgi-local....." which we've moved everything off of using cgi-local.

It's a cycling forum that's pointing to one of our old pages. But I don't know what it is.

I just thought it was an interesting point to bring up. Anyone else seeing this?

tedster

1:43 am on Dec 11, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



When you remove a url of any kind, googlebot will continue to request it on a declining frequency, and so you'll see an error report. If it's causing you a problem, you can use robots.txt to stop the googlebot requests.

Propools

3:11 pm on Dec 11, 2008 (gmt 0)

10+ Year Member



I've got robots.txt set up to exclude those URL's.
Do you think I should be specific to "googlebot" in the robots.txt file?

tedster

9:33 pm on Dec 11, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Not needed - just make sure the robots.txt is valid and actually giving the instructions you intend, even in other lines. You can use the tool in WMT to check.