Forum Moderators: open
Some spiders have historically had a hard time with http 1.1 and have not used "domain" http headers.
The question I'm curious about is if anyone really knows what the current status is of these spiders Brett is talking about; whether they are still around, and whether or not the following advice is still current:
Posted by Brett_Tabke on Feb. 3, 2002:
...virtual hosting is still dicey. I don't trust the spiders or all se's to get it right... It was just last fall that there was one major engine that had problems with virtual hosted sites"
Posted by Brett_Tabke on Feb. 2, 2001:
The majors have it figured out and support http 1.1+ properly... That said, I would not put a primary grade A site on a virtual host.
Also, somewhat related to the above is a question as to why whenever almost any (even major) spider choose to visit, they almost always are using "HTTP/1.0". Is this somthing that is expected to change to "HTTP/1.1" as time goes on, or is there no real need for them to change because the spiders are using the "domain" http headers?
I would greatly appreciate any insight that anyone could share with me on this topic.
