Welcome to WebmasterWorld Guest from 184.108.40.206
I just moved my site from static html pages to a php based CMS/mysql database. Everything is going well so far. Spiders can get to my site and can follow through the internal links but are omitting the domain name in their indexing.
Instead of indexing: http://www.example.com/directory/article1
they index it as:
How can I resolve this through a general rule without having to create a Rewrite Rule for each piece of content.
[edited by: jdMorgan at 1:19 am (utc) on Oct. 2, 2005]
[edit reason] Example.com, de-linked. [/edit]
If you cannot 'see' the malformed URLs using your regular browser settings, then try spoofing a search engine robot user-agent with your browser or with something like WannaBrowser.
There is no way to 'repair' these search engine listings for the simple reason that a URL like 'http://directory/article1' won't resolve to your host (or to any host). If the spider can't follow that link to your host, then you can't intercept the request and redirect it to 'fix' the URL in the search engine's index.