Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Does content type matter?

is text/html okay

6:15 pm on Nov 7, 2003 (gmt 0)

New User

10+ Year Member

joined:Aug 23, 2003
votes: 0

It's a long story but basically my robots.txt gets sent with a "text/html" content-type header instead of the normal "text/plain".

will this affect SE's ability to read it? I doubt it but just want to make sure. thanks

8:27 am on Nov 8, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Jan 7, 2003
votes: 0

fairly a good question. i can only assume that it does not make a difference that much because it starts with text/, but i can't tell you, because this is very specific about which robot is looking for it etc. any can do such a check for mimetype or not. maybe someone here made a testscenario about that already, but i don't know.

if you want to have this corrected (on my server it's text/plain and i have no probs), contact your server admin.


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members