How to read large text file on windows? [closed]
try this… Large Text File Viewer By the way, it is free 🙂 But, I think you should ask this on serverfault.com instead
large-files
Best Free Text Editor Supporting *More Than* 4GB Files? [closed]
glogg could also be considered, for a different usage: Caveat (reported by Simon Tewsi in the comments, Feb. 2013) One caveat – has two search functions, Main Search and Quick Find. The lower one, which I assume is Quick Find, is at least an order of magnitude slower than the upper one, which is fast.
gitignore by file size?
I’m new to .gitignore, so there may be better ways to do this, but I’ve been excluding files by file size using: find . -size +1G | cat >> .gitignore Obviously you’ll have to run this code frequently if you’re generating a lot of large files.
Is there a memory efficient and fast way to load big JSON files?
There was a duplicate to this question that had a better answer. See https://stackoverflow.com/a/10382359/1623645, which suggests ijson. Update: I tried it out, and ijson is to JSON what SAX is to XML. For instance, you can do this: import ijson for prefix, the_type, value in ijson.parse(open(json_file_name)): print prefix, the_type, value where prefix is a dot-separated … Read more
How can I import a large (14 GB) MySQL dump file into a new MySQL database?
I’ve searched around, and only this solution helped me: mysql -u root -p set global net_buffer_length=1000000; –Set network buffer length to a large byte number set global max_allowed_packet=1000000000; –Set maximum allowed packet size to a large byte number SET foreign_key_checks = 0; –Disable foreign key checking to avoid delays,errors and unwanted behaviour source file.sql –Import … Read more
HTML5 – How to stream large .mp4 files?
Ensure that the moov (metadata) is before the mdat (audio/video data). This is also called “fast start” or “web optimized”. For example, Handbrake has a “Web Optimized” checkbox, and ffmpeg and avconv have the output option -movflags faststart. Ensure that your web server is reporting the correct Content-Type (video/mp4). Ensure that your web server is … Read more
python: read lines from compressed text files
Using gzip.GzipFile: import gzip with gzip.open(‘input.gz’,’rt’) as f: for line in f: print(‘got line’, line) Note: gzip.open(filename, mode) is an alias for gzip.GzipFile(filename, mode). I prefer the former, as it looks similar to with open(…) as f: used for opening uncompressed files.
Reading large text files with streams in C#
You can improve read speed by using a BufferedStream, like this: using (FileStream fs = File.Open(path, FileMode.Open, FileAccess.Read, FileShare.ReadWrite)) using (BufferedStream bs = new BufferedStream(fs)) using (StreamReader sr = new StreamReader(bs)) { string line; while ((line = sr.ReadLine()) != null) { } } March 2013 UPDATE I recently wrote code for reading and processing (searching … Read more
Working with huge files in VIM
I had a 12GB file to edit today. The vim LargeFile plugin did not work for me. It still used up all my memory and then printed an error message :-(. I could not use hexedit for either, as it cannot insert anything, just overwrite. Here is an alternative approach: You split the file, edit … Read more
How to find the largest file in a directory and its subdirectories?
Quote from this link- If you want to find and print the top 10 largest files names (not directories) in a particular directory and its sub directories $ find . -type f -printf ‘%s %p\n’|sort -nr|head To restrict the search to the present directory use “-maxdepth 1” with find. $ find . -maxdepth 1 -printf … Read more