character-encoding – Page 8

ASP.NET Excel export encoding problem

July 21, 2023 by Tarik

Well I found out that the problem could be in the header of the excel file, that it does not contain the BOM byte sequence (at the beginning of the file representing the encoding used). So I made it this way and it works for me: Response.Clear(); Response.AddHeader(“content-disposition”,”attachment;filename=Test.xls”); Response.ContentType = “application/ms-excel”; Response.ContentEncoding = System.Text.Encoding.Unicode; Response.BinaryWrite(System.Text.Encoding.Unicode.GetPreamble()); … Read more

PDO + MySQL and broken UTF-8 encoding [duplicate]

July 19, 2023 by Tarik

UTF8 Script in PowerShell outputs incorrect characters

July 16, 2023 by Tarik

Changing the encoding of the script to UTF-8 with BOM solved the issue. I was using SublimeText with the EncodingHelper plugin to control the character-set of the script. It was set correctly to UTF8. I changed the encoding of the script in SublimeText to “UTF-8 with BOM” and the output was shown correctly. I created … Read more

There is no Unicode byte order mark. Cannot switch to Unicode

July 13, 2023 by Tarik

The reality of your file’s encoding appears to conflict with that specified by your XML declaration. If your file actually uses one-byte characters, declaring encoding=”utf-16″ won’t change it to use two-byte characters, for example. Try removing the conflicting encoding from the XML declaration. Replace <?xml version=”1.0″ encoding=”utf-16″?> with <?xml version=”1.0″?> You may also be able … Read more

How to replace Microsoft-encoded quotes in PHP

July 1, 2023 by Tarik

I have found an answer to this question. You need just one line of code using iconv() function in php: // replace Microsoft Word version of single and double quotations marks (“ ” ‘ ’) with regular quotes (‘ and “) $output = iconv(‘UTF-8’, ‘ASCII//TRANSLIT’, $input);

‘git log’ output encoding issues in Windows 10 CLI terminal

June 27, 2023 by Tarik

Okay, I experimented a bit and found out that Windows Git commands actually need UNIX variables like LC_ALL in order to display Polish (or other UTF-8 characters) correctly. Just try this command: set LC_ALL=C.UTF-8 Then enjoy the result. Here is what happened on my console (font “Consolas”, no chcp necessary): Update: Well, in order for … Read more

MySQL: Get character-set of database or table or column?

June 15, 2023 by Tarik

Here’s how I’d do it – For Schemas (or Databases – they are synonyms): SELECT default_character_set_name FROM information_schema.SCHEMATA WHERE schema_name = “mydatabasename”; For Tables: SELECT CCSA.character_set_name FROM information_schema.`TABLES` T, information_schema.`COLLATION_CHARACTER_SET_APPLICABILITY` CCSA WHERE CCSA.collation_name = T.table_collation AND T.table_schema = “mydatabasename” AND T.table_name = “tablename”; For Columns: SELECT character_set_name FROM information_schema.`COLUMNS` WHERE table_schema = “mydatabasename” AND table_name … Read more

How to type a new line character in SQL Server Management Studio

June 13, 2023 by Tarik

You can’t. (Edit: other good answers have been posted with some workable methods.) My preferred method to do this is via a direct SQL update. Two general techniques: –Literal returns inside strings UPDATE mytable SET textvalue=”This text can include line breaks” WHERE rowid = 1234 –Concatenating CHAR codes UPDATE mytable SET textvalue=”This text” + CHAR(10) … Read more

Python script to convert from UTF-8 to ASCII [duplicate]

June 13, 2023 by Tarik

data=”UTF-8 DATA” udata=data.decode(“utf-8”) asciidata=udata.encode(“ascii”,”ignore”)

What’s the ASCII character code for ‘—’?

June 13, 2023 by Tarik

Quotation from wiki (Em dash) When an actual em dash is unavailable—as in the ASCII character set—a double (“–“) or triple hyphen-minus (“—“) is used. In Unicode, the em dash is U+2014 (decimal 8212). Em dash character is not a part of ASCII character set.