Forum Moderators: open
Does the the web crawler actually make a http request to server side?
I am asking this because "I" want to put
the tags as example " <a href="./whatever.html>KEYWORD</a>
instead of the server side info at the bottom
Wondering if this would booster the web crawler position?
Thanks, Great Forum
Does the the web crawler actually make a http request to server side?
The spider will connect to www.yourdomain.tld and request the URI "/". Your webserver will then serve that resource. In case of a server side script it will execute the script and serve the final result.
In your case this will include the links at the bottom of your page. The spider will never know that a server side script was involved in building the document that it is sent.
Of course, you could include different things depending of the User-Agent field in the http request header or the ip address the request came from. That would be cloaking.
BTW you might want to remove the URL from your post. You may put it into your profile.
Hope this helps.
Andreas