Plain text files not interpreted as Unicode

[ghost]

When uploading a plain text file encoded as Utf8 to a Next Cloud instance and opening it in the app, it gets partially unreadable.

The default encoding for text files should be Utf8.

[marinofaggiana]

please @joelmeyerhamme attachment a example test file.

[ghost]

The attached Utf8 encoded file containing ä gets interpreted as ä in ISO Latin 1.
test.txt

[marinofaggiana]

i see :

[ghost]

The bug appears to be specific to the .md file ending for Markdown. Haven't thought of that, sorry for not including it in the initial comment.

[marinofaggiana]

oh Yes, true.

[rakekniven]

Did some tests.

Created three textfiles. Their names should explain everything. You will see screenshots for each file as well.

test-ansi.txt
test-utf8-wo-bom.txt
test-utf8-w-bom.txt

OK

OK

The UTF-8 file withoud BOM fails.

[KeiOtori]

I have the same issue here: after opening file content in UTF-8, viewer looks weird.
But i can copy broken text, and paste it into other app - there i see it in correct form.

Here is my example:

• What i was supposed to see:
  

• What i really see:
  

My test file is attached, it is encoded in UTF-8, but in iOS app it is misinterpreted as Windows-1252 / CP-1252 (??)
TestingEncoding.txt

EDIT:
Oh, just found it out: if i manually convert this file from UTF-8 to UTF-8-BOM (in terms of notepad++, adding BOM char to the file?) - everything works and looks great. Maybe the issue is incorrect detection of encoding for UTF files without BOM?

[marinofaggiana]

Thanks @KeiOtori I make a test

[marinofaggiana]

fixed.

[rakekniven]

@marinofaggiana This is working AFAICS, or?

[marinofaggiana]

yes.

[binss]

@marinofaggiana I still have this issue when I open the markdown(.md) file, but txt file display well

I have file test.md with content:

你好
こんにちは
hello

It seem wrong as md file:

but good as txt file

EDIT:

The test.md is encoded in UTF-8. When I transform it to UTF-8 with BOM, It seems good.

[uiharu-s]

May I ask why this issue is closed? I’m still encountering this issue in the latest published version (2.20.8), specifically md with East Asian characters getting misencoded.

Edit: I see it’s included in a milestone, sorry

[rakekniven]

The issues is about plain text files with file extension txt.
Could you please try to copy your file and change extension md to txt and give some feedback?

[binss]

When I change extension to txt, it shows correctly. I guess it maybe a decode problem for md extension file with plain text.

[marinofaggiana]

@binss try with the next beta 2.21.0.00016

[rakekniven]

@marinofaggiana Bugfixing for feature release?

Is this related with #471

[ldesgrange]

Hi,

I still have a variant of this issue (but much less important). If I create a UTF-8 text file on my computer then in iOS app (2.22.2.2):

• synchronize
• when opening it shows the file correctly
• when editing the encoding is fine too
• save
• file shows with the wrong encoding
• going back to the folder and reopening the file shows it fine again.

So it looks like that only the view after saving the file has a wrong encoding.