I am stunned at the number of responses that imply that such a thing is impossible. Have these people never heard of “compressed file systems”, which have been around since before Microsoft was sued in 1993 by Stac Electronics over compressed file system technology? I hear that LZS and LZJB are popular algorithms for people … Read more
I found this deque implementation from Wikipedia: Storing contents in multiple smaller arrays, allocating additional arrays at the beginning or end as needed. Indexing is implemented by keeping a dynamic array containing pointers to each of the smaller arrays. I guess it answers my question.
Take a look at dictzip. It is compatible with gzip and allows coarse random access. An excerpt from its man page: dictzip compresses files using the gzip(1) algorithm (LZ77) in a manner which is completely compatible with the gzip file format. An extension to the gzip file format (Extra Field, described in 2.3.1.1 of RFC … Read more
SELECT * FROM table ORDER BY RANDOM() LIMIT 1;