phranque
msg:4111229 | 7:00 am on Apr 7, 2010 (gmt 0) |
is there a sitemap directive specified in your robots.txt file?
|
meelosh
msg:4111430 | 2:40 pm on Apr 7, 2010 (gmt 0) |
no there is not phranque.....should i just block it there?
the file is coming up 404 so i assumed that george would stop looking for it after awhile but it has been now for almost 4 months and spends more time looking for this sitemap.php than anything else.
|
phranque
msg:4111752 | 11:05 pm on Apr 7, 2010 (gmt 0) |
no, not blocking - i was referring to Specifying the Sitemap location in your robots.txt file [sitemaps.org].
are the requests coming from an inbound link or these all unreferred?
|
meelosh
msg:4112463 | 4:45 pm on Apr 8, 2010 (gmt 0) |
thanks phranque......i think i have got it sorted.
thanks for taking the time
cheers
|
|
