For Python 3.2+/2.7+ you can view (__repr__‘s of) pickles from the command-line: $ python -c “import pickle; pickle.dump({‘hello’: ‘world’}, open(‘obj.dat’, ‘wb’))” $ python -mpickle obj.dat {‘hello’: ‘world’} It should be easy to integrate this into the Windows shell.
Pickle is unsafe because it constructs arbitrary Python objects by invoking arbitrary functions. However, this is also gives it the power to serialize almost any Python object, without any boilerplate or even white-/black-listing (in the common case). That’s very desirable for some use cases: Quick & easy serialization, for example for pausing and resuming a … Read more
I know this is a very old question, but I have never explicitly seen a satisfactory solution to this question other than the obvious, and most likely correct, answer to re-structure your code. Unfortunately, it is not always practical to do such a thing, in which case as a very last resort, it is possible … Read more
csv ✅human readable ✅cross platform ⛔slower ⛔more disk space ⛔doesn’t preserve types in some cases pickle ✅fast saving/loading ✅less disk space ⛔non human readable ⛔python only Also take a look at parquet format (to_parquet, read_parquet) ✅fast saving/loading ✅less disk space than pickle ✅supported by many platforms ⛔non human readable
The issue is that you’re pickling objects defined in Settings by actually running the ‘Settings’ module, then you’re trying to unpickle the objects from the GUI module. Remember that pickle doesn’t actually store information about how a class/object is constructed, and needs access to the class when unpickling. See wiki on using Pickle for more … Read more
I needed to achieve the same thing too. I turns out it caused me quite a headache before I finally figured out, thanks to this post, how to actually make it work in a binary format. To insert/update: pdata = cPickle.dumps(data, cPickle.HIGHEST_PROTOCOL) curr.execute(“insert into table (data) values (:data)”, sqlite3.Binary(pdata)) You must specify the second argument … Read more
You should use numpy.save and numpy.load.
One way to handle instance attributes that are not picklable objects is to use the special methods available for modifying a class instance’s state: __getstate__() and __setstate__(). Here is an example class Foo(object): def __init__(self, value, filename): self.value = value self.logfile = file(filename, ‘w’) def __getstate__(self): “””Return state values to be pickled.””” f = self.logfile … Read more
Try using the json library instead of pickle. This should be an option in your case because you’re dealing with a dictionary which is a relatively simple object. According to this website, JSON is 25 times faster in reading (loads) and 15 times faster in writing (dumps). Also see this question: What is faster – … Read more
There is lots of information about this available. For the “official word” on the issue, read the (closed) Python bugtracker issue. The core reasoning, by one of the people who made the decision, is detailed on this blog: Since a generator is essentially a souped-up function, we would need to save its bytecode, which is … Read more