Welcome to WebmasterWorld Guest from 54.144.68.27

Forum Moderators: incrediBILL

Message Too Old, No Replies

Some text coding error?! or HTML error?

?...

     

Noximus

10:59 am on Jun 27, 2014 (gmt 0)

10+ Year Member



Hello Friends,
I have got some articles from the writer in .docx ,
when I copy the mentioned articles in html editor, dreamweaver or even in generic text file I get the strange coding of the text... I contacted the writer and he can't change the coding too... I also tried to convert the articles in pdf and then copy the text from it... and the same again... I tried on different PC-s and got another version of text coding..

Please tell me how to sort out this text coding problem in html...

for clarification please check the screenshots:
[b.pix.ge...]

[b.pix.ge...]

Thank you in advance

lucy24

6:45 pm on Jun 27, 2014 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



Holy ###.

My first response, before even looking at the screenshots, was: It isn't enough to look at the html code. That's simply what is sent to your browser. You need to know how the html was created in the first place, whether hand-rolled or made by custom php or a CMS.

My second response, after a cursory glance at the screenshots, was: Oh, I get it, all the non-ASCII characters are getting converted to decimal entities. (Interestingly there was a post just a few days ago leading to the discovery that some mobiles don't "do" decimal entities; it has to be hexadecimal.)

In fact it's worse: about half of the ordinary letters are being rendered as decimal code for absolutely no reason. I really, really hope this isn't happening in the server, as it means that about every other letter takes up seven times as many bytes as it needs to.

The encoding is random, rather than consistent: here an "o", there a "о" and similar.

One of your two screenshots shows the text as-is-- except for the somewhat glaring issue of <br> where <p></p> seems to be warranted. So what's wrong with starting with that version?

In any case, there's no earthly reason why ordinary ASCII characters would be converted into decimal entities. You may need to lean a little harder on your writer.

Noximus

7:33 pm on Jun 27, 2014 (gmt 0)

10+ Year Member



lucy24,
Thank you for your response very much.
All the text I have got is in word file, .docx not from the server...

as for "One of your two screenshots shows the text as-is-- except for the somewhat glaring issue of <br> where <p></p> seems to be warranted. So what's wrong with starting with that version? "

The first screenshot is not normal, just it is seen on one computer's Dreamveawer and the second screenshot on another one's .

So what should I do to convert all the text in normal coding? to avoid problems with search engines?

not2easy

8:07 pm on Jun 27, 2014 (gmt 0)

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



Have you tried to copy from the browser screen and paste into an actual text editor such as Notepad++? That might possibly give you uniformity that could then be pasted into the appropriate places on your .html document. I have nothing comparable to try it out with, so this is just a basic idea. It is the first thing I'd try to use to fix it if it happened to me.

not2easy

8:09 pm on Jun 27, 2014 (gmt 0)

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



One other idea - can you open the .docx file and save it as a .txt document?

Noximus

8:26 pm on Jun 27, 2014 (gmt 0)

10+ Year Member



Yes, I have tried both of them... nothing helps...

Please try to convert the text below to decent coding or tell me how to do it.

Here is the sample of the text (which is copied from the .docx file), I try to convert in uniform coding:

"Last minut&#1077; tr&#1072;v&#1077;l - wh&#1077;r&#1077; t&#1086; find th&#1077; b&#1077;&#1109;t deals
S&#1086;m&#1077;tim&#1077;&#1109; if tim&#1077; i&#1109; &#1086;n your &#1109;id&#1077; the v&#1077;r&#1091; b&#1077;&#1109;t w&#1072;&#1091; to tr&#1072;v&#1077;l i&#1109; L&#1072;&#1109;t Minut&#1077; Tr&#1072;v&#1077;l. Y&#1086;u can &#1086;ft&#1077;n find th&#1077; very b&#1077;&#1109;t &#1089;h&#1077;&#1072;&#1088; tr&#1072;v&#1077;l d&#1077;&#1072;l&#1109; this w&#1072;&#1091;. Oft&#1077;n you &#1089;&#1072;n find m&#1072;n&#1091; such deals to &#1077;v&#1077;n f&#1072;r&#1072;w&#1072;&#1091; places lik&#1077; M&#1072;l&#1072;&#1091;&#1109;i&#1072; &#1086;r Singapore or &#1077;v&#1077;n some &#1086;f your &#1086;th&#1077;r dr&#1077;&#1072;m l&#1086;&#1089;&#1072;ti&#1086;n&#1109;. In fact more &#1086;ft&#1077;n than none the faraway &#1088;l&#1072;&#1089;&#1077;&#1109; offer th&#1077; b&#1077;&#1109;t v&#1072;lu&#1077; f&#1086;r m&#1086;n&#1077;&#1091; wh&#1077;n it i&#1109; a l&#1072;&#1109;t minut&#1077; travel d&#1077;&#1072;l.
R&#1077;&#1072;&#1109;&#1086;n&#1109; Why L&#1072;&#1109;t minute tr&#1072;v&#1077;l d&#1077;&#1072;l&#1109; &#1072;r&#1077; &#1109;&#1086; good include:- "

lucy24

9:11 pm on Jun 27, 2014 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



I was going to say:

For heaven's sake. All you have to do is paste the text-- including entities-- into any text editor with an HTML preview function.

But then things get interesting as I realize belatedly that those are not ASCII character entities. I'm really sorry I didn't home in on this in the first place, because it should have been obvious.

What you've got is decimal characters in the 107x-110x range, corresponding to hexadecimal 04xx. Those are Cyrillic letters that happen to have the same letterforms as assorted Roman letters. And there's no legitimate reason for that to happen. There's a CJK process that's loosely analogous and can be legitimate. But this? Nuh-uh.

So there's something going on that either your designer isn't telling you, or you're not telling us.

not2easy

10:23 pm on Jun 27, 2014 (gmt 0)

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month



some articles from the writer
Is the writer in an area where they might be using a PC configured for the Cyrillic characters by default? Or perhaps does occasional work with that setting? If so they should be able to adjust that and send it back in whatever format you use. If your machine is not and theirs is not, I would triple check for malware at both ends.

lucy24

1:02 am on Jun 28, 2014 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



a PC configured for the Cyrillic characters by default

I really doubt that's the explanation. If so, you'd be seeing randomized garbage of a very distinctive kind, where one 1-byte encoding is getting interpreted as a different 1-byte encoding. These are clearly unicode characters. It's especially striking in the first screenshot-- once you know what you're looking for-- because the non-Roman characters are in a different font. In fact the shoe didn't drop for me until I tried pasting from html preview back into this thread; SEE's www preview happens to use a serif font in which Cyrillic is extremely similar to Roman in overall size and shape.

Hoople

1:17 am on Jun 28, 2014 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



A DOCX file is a compressed file and newer version of DOC files. I would save it first as a DOC file for Word 95/2003 making sure the language and character set is Western or UTF8.

Many versions of Word have the option 'Save As Filtered HTML' in the 'Save As' dialogue. This will filter out all the proprietary MS inline CSS and XML

There are online pages that do the same all in one. A few add a site footer, beware!

Noximus

8:15 am on Jun 28, 2014 (gmt 0)

10+ Year Member



Thank you all for the feedbacks!

I solved the problem by converting the docx to jpg and then jpg to text!

and now I can use finally this text!

P.s. the writer may be in Russia, but I'm not sure.
p.s.2. It is fairly possible that the PC of the writer is infected because he sent me(over fiverr) several times the articles in .doc, docx, .pdf and all the same coding errors happen.

lucy24

10:37 am on Jun 28, 2014 (gmt 0)

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



and then jpg to text!

Huh what? You mean you made images of the text and then did OCR on it? That sounds like the tag end of a Clients From Hell story :)

I'd think it would be faster to globally replace the entities: thing-that-looks-like-e into "e", thing-that-looks-like-o into "o" and so on. There are only about half a dozen different ones, mainly vowels. But I guess it can't have been that time-consuming, if you've already done it.

tangor

4:59 pm on Jun 28, 2014 (gmt 0)

WebmasterWorld Senior Member tangor is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



Don't overlook the File Save as SIMPLE HTML which WORD or OFFICE allows. If you are not using a MS valid program you'll get very strange results. Your best move is to download from the Microsoft website the docx VIEWER (it's free). It appears you don't have that minimum app in use, or you are attempting to open docx in an older version of Word.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month