Using .NET’s UTF8Encoding class and passing $False to the constructor seems to work: $MyRawString = Get-Content -Raw $MyPath $Utf8NoBomEncoding = New-Object System.Text.UTF8Encoding $False [System.IO.File]::WriteAllLines($MyPath, $MyRawString, $Utf8NoBomEncoding)
Simple: byte[] data = Convert.FromBase64String(encodedString); string decodedString = Encoding.UTF8.GetString(data);
As of Node.js v6.0.0 using the constructor method has been deprecated and the following method should instead be used to construct a new buffer from a base64 encoded string: var b64string = /* whatever */; var buf = Buffer.from(b64string, ‘base64’); // Ta-da For Node.js v5.11.1 and below Construct a new Buffer and pass ‘base64’ as … Read more
The data is UTF-8 encoded bytes escaped with URL quoting, so you want to decode, with urllib.parse.unquote(), which handles decoding from percent-encoded data to UTF-8 bytes and then to text, transparently: from urllib.parse import unquote url = unquote(url) Demo: >>> from urllib.parse import unquote >>> url=”example.com?title=%D0%BF%D1%80%D0%B0%D0%B2%D0%BE%D0%B2%D0%B0%D1%8F+%D0%B7%D0%B0%D1%89%D0%B8%D1%82%D0%B0″ >>> unquote(url) ‘example.com?title=правовая+защита’ The Python 2 equivalent is urllib.unquote(), … Read more
Your code works when run in an script because Python encodes the output to whatever encoding your terminal application is using. If you are piping you must encode it yourself. A rule of thumb is: Always use Unicode internally. Decode what you receive, and encode what you send. # -*- coding: utf-8 -*- print u”åäö”.encode(‘utf-8’) … Read more
Since this thread is a popular result in google search, here is the way to do it for sublime text 3 build 3059+: in user preferences, add the line: “show_encoding”: true
Answering myself as the FAQ of this site encourages it. This works for me: Mostly characters äåö are not a problematic as the default character set used by browsers and tomcat/java for webapps is latin1 ie. ISO-8859-1 which “understands” those characters. To get UTF-8 working under Java+Tomcat+Linux/Windows+Mysql requires the following: Configuring Tomcat’s server.xml It’s necessary … Read more
Python 2 From the documentation: urllib.quote(string[, safe]) Replace special characters in string using the %xx escape. Letters, digits, and the characters ‘_.-‘ are never quoted. By default, this function is intended for quoting the path section of the URL.The optional safe parameter specifies additional characters that should not be quoted — its default value is … Read more
It sounds like you’re looking for enca. It can guess and even convert between encodings. Just look at the man page. Or, failing that, use file -i (Linux) or file -I (OS X). That will output MIME-type information for the file, which will also include the character-set encoding. I found a man-page for it, too 🙂
Q Does a base64 string always end with =? A: No. (the word usb is base64 encoded into dXNi) Q Why does an = get appended at the end? A: As a short answer: The last character (= sign) is added only as a complement (padding) in the final process of encoding a message with … Read more