Forum Moderators: phranque
my-valid-url1.html!RSTB_ERROR_NCURL_IGNORE_ALL
my-valid-url2.html!RSTB_ERROR_NCURL_IGNORE_ALL
my-valid-url3.html!RSTB_ERROR_NCURL_IGNORE_ALL
my-valid-url4.html!RSTB_ERROR_NCURL_IGNORE_ALL
Apart of this my awstats 404 entries are also showing huge number of urls as 404 which were never been there in the site.
myfolder/mypage.html - valid url
myfolder/myotherfolder/myotherfolder/mypage.html - invalid url - caught in 404 entries
I am surprized how come ppl reached to those urls which are not available in the site and never been there online or offline.
is it the user egenrated entries or a scraper cud be the reason
cURL is a command line program to get, and more importantly submit, data as if you were doing so from a browser. It's positive use is to, say, submit a secure form on your site then send that data to a credit card processor then return the response to the browser so the user never leaves your site.
In this case they are using curl to try and "get" those pages, and there is a curl error. A quick Google of that specific error reveals very little; the curl error page [curl.haxx.se] doesn't list it so I can only **presume** this error is being generated by the rogue bot attempting to use curl and is an indicator your server settings are refusing all requests from cURL (?) Others may have actual accurate information . . .