Forum Moderators: coopster & phranque

Message Too Old, No Replies

Links in the <head>. Would be crawled?

         

hon123

10:04 am on Aug 13, 2002 (gmt 0)

10+ Year Member



Hi to all,
I need some advice for an optimization i've done, if you think it could work.

The initial problem was always the same, the site, in php, had no keywords at all in the text and client would not modify it.

To overcome it I've created a link <link rel="Glossario" href="yyyyyyy.html" type="text/html"> in the <HEAD> towards a page with the right txt in it.

I've hidden the yyyyyyy.html with mod_rewrite [R] and created a server side redir
(error 404) to a site_map.html (for users).

I've controlled the behaviour of the spiders and found that they arrive to the site_map.html too but have not seen the
crawling of the linked page (yyyyyyy.html).

What d'you think about that?
Hope to have been clear enough.

Many thank for your advice.

IanTurner

3:04 pm on Aug 13, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



It will depend how your logging software works, if it works on completion of the request then the request for yyyyyy.htm is never completed because it server side redirects to sitemap.html - and effectively becomes a request for sitemap.html

hon123

3:49 pm on Aug 13, 2002 (gmt 0)

10+ Year Member



Putting [R] at the end of the rule in the mod_rewrite i think just the users get a 404 error...
the spiders should see the correct page, isn't it?