The following is a one-liner solution utilizing tqdm: import pandas as pd from tqdm import tqdm df = pd.concat([chunk for chunk in tqdm(pd.read_csv(file_name, chunksize=1000), desc=”Loading data”)]) If you know the total lines to be loaded, you can add that information with the parameter total to the tqdm fuction, resulting in a percentage output.
Problem is your data contains NaN values, so int is automatically cast to float. I think you can check NA type promotions: When introducing NAs into an existing Series or DataFrame via reindex or some other means, boolean and integer types will be promoted to a different dtype in order to store the NAs. These … Read more
The PythonAnywhere help pages offer information on working with PDF files here: https://help.pythonanywhere.com/pages/PDF Summary: PythonAnywhere has a number of Python packages for PDF manipulation installed, and one of them may do what you want. However, shelling out to abiword seems easiest to me. The shell command abiword –to=pdf filetoconvert.docx will convert the docx file to … Read more
Regarding Installer Program (for windows). I think what you are looking for is InstallForge. This is a tool that you can use to build your own installation wizard. This website pythonguis is a tutorial for PyInstaller and InstallForge. You can skip the PyInstaller part and go towards the middle to view the InstallForge tutorial if … Read more
The fastest version w/o overoptimizing the code I’ve got with the following code: class CTError(Exception): def __init__(self, errors): self.errors = errors try: O_BINARY = os.O_BINARY except: O_BINARY = 0 READ_FLAGS = os.O_RDONLY | O_BINARY WRITE_FLAGS = os.O_WRONLY | os.O_CREAT | os.O_TRUNC | O_BINARY BUFFER_SIZE = 128*1024 def copyfile(src, dst): try: fin = os.open(src, READ_FLAGS) stat … Read more
I am taking @Taar’s comment and making it an actual answer since it worked for the original person who asked the question and for myself. from IPython.display import display, Javascript display(Javascript(‘IPython.notebook.save_checkpoint();’)) This will create checkpoints – same thing as CTRL-s. Note: in Jupyter, CTRL-s triggers an async process and the file save is actually completed … Read more
Checking if a variable conforms to a typing object To check if string_list conforms to string_list_class, you can use the typeguard type checking library. from typeguard import check_type try: check_type(‘string_list’, string_list, string_list_class) print(“string_list conforms to string_list_class”) except TypeError: print(“string_list does not conform to string_list_class”) Checking the generic type of a typing object To check if … Read more
The tox-conda plugin should close that gap nowadays, but needs contributors who actively use conda to test and improve it. from the README: tox-conda is a plugin that provides integration with the conda package and environment manager for the tox automation tool. It’s like having your cake and eating it, too! By default, tox creates … Read more
After some trial and error I found out how to interprete the results of scipy.signal.deconvolve() and I post my findings as an answer. Let’s start with a working example code import numpy as np import scipy.signal import matplotlib.pyplot as plt # let the signal be box-like signal = np.repeat([0., 1., 0.], 100) # and use … Read more