I’d recommend reading that PEP the error gives you. The problem is that your code is trying to use the ASCII encoding, but the pound symbol is not an ASCII character. Try using UTF-8 encoding. You can start by putting # -*- coding: utf-8 -*- at the top of your .py file. To get more … Read more
On Linux, filenames are ‘just a bunch of bytes’, and are not necessarily encoded in a particular encoding. Python 3 tries to turn everything into Unicode strings. In doing so the developers came up with a scheme to translate byte strings to Unicode strings and back without loss, and without knowing the original encoding. They … Read more
You are passing in a string object to a bytearray(): bytearray(content[current_pos:(final_pos)]) You’ll need to supply an encoding argument (second argument) so that it can be encoded to bytes. For example, you could encode it to UTF-8: bytearray(content[current_pos:(final_pos)], ‘utf8’) From the bytearray() documentation: The optional source parameter can be used to initialize the array in a … Read more
Unicode escapes only work in unicode strings, so this a=”\u2026″ is actually a string of 6 characters: ‘\’, ‘u’, ‘2’, ‘0’, ‘2’, ‘6’. To make unicode out of this, use decode(‘unicode-escape’): a=”\u2026″ print repr(a) print repr(a.decode(‘unicode-escape’)) ## ‘\\u2026′ ## u’\u2026’
“你好”.encode(‘utf-8′) encode converts a unicode object to a string object. But here you have invoked it on a string object (because you don’t have the u). So python has to convert the string to a unicode object first. So it does the equivalent of “你好”.decode().encode(‘utf-8′) But the decode fails because the string isn’t valid ascii. … Read more
To include Unicode characters in your Python source code, you can use Unicode escape characters in the form \u0123 in your string. In Python 2.x, you also need to prefix the string literal with ‘u’. Here’s an example running in the Python 2.x interactive console: >>> print u’\u0420\u043e\u0441\u0441\u0438\u044f’ Россия In Python 2, prefixing a string … Read more
I’d recommend reading that PEP the error gives you. The problem is that your code is trying to use the ASCII encoding, but the pound symbol is not an ASCII character. Try using UTF-8 encoding. You can start by putting # -*- coding: utf-8 -*- at the top of your .py file. To get more … Read more
http://docs.python.org/howto/unicode.html#the-unicode-type str = unicode(str, errors=”replace”) or str = unicode(str, errors=”ignore”) Note: This will strip out (ignore) the characters in question returning the string without them. For me this is ideal case since I’m using it as protection against non-ASCII input which is not allowed by my application. Alternatively: Use the open method from the codecs … Read more
You need to read the Python Unicode HOWTO. This error is the very first example. Basically, stop using str to convert from unicode to encoded text / bytes. Instead, properly use .encode() to encode the string: p.agent_info = u’ ‘.join((agent_contact, agent_telno)).encode(‘utf-8’).strip() or work entirely in unicode.