Below is a copy of an example trailer I copied from The TCP/IP Guide site. As we can see, if we want to use trailer header, we need add a “Trailer:header_name” header field with a header name and then add the trailer header entity after chunked body area. We can add 0 or more trailer … Read more
The important thing to keep in mind is that File inherits from Blob, File doesn’t actually have a slice method, it gets this method from Blob. File just adds a couple metadata attributes. The best way to think of a Blob (or File) is as a pointer to data, but not the actual data itself. … Read more
with open(<FILE>) as FileObj: for lines in FileObj: print lines # or do some other thing with the line… will read one line at the time to memory, and close the file when done…
You don’t need to make new slices, just append slices of logs to the divided slice. http://play.golang.org/p/vyihJZlDVy var divided [][]string chunkSize := (len(logs) + numCPU – 1) / numCPU for i := 0; i < len(logs); i += chunkSize { end := i + chunkSize if end > len(logs) { end = len(logs) } divided … Read more
Elegance is in the eye of the beholder. If you don’t mind using a stateful function in groupingBy, you can do this: AtomicInteger counter = new AtomicInteger(); stream.collect(groupingBy(x->counter.getAndIncrement()/chunkSize)) .values() .forEach(database::flushChunk); This doesn’t win any performance or memory usage points over your original solution because it will still materialize the entire stream before doing anything. If … Read more
Use String#scan: >> ‘abcdefghijklmnopqrstuvwxyz’.scan(/.{4}/) => [“abcd”, “efgh”, “ijkl”, “mnop”, “qrst”, “uvwx”] >> ‘abcdefghijklmnopqrstuvwxyz’.scan(/.{1,4}/) => [“abcd”, “efgh”, “ijkl”, “mnop”, “qrst”, “uvwx”, “yz”] >> ‘abcdefghijklmnopqrstuvwxyz’.scan(/.{1,3}/) => [“abc”, “def”, “ghi”, “jkl”, “mno”, “pqr”, “stu”, “vwx”, “yz”]
This is probably more efficient (faster) def batch(iterable, n=1): l = len(iterable) for ndx in range(0, l, n): yield iterable[ndx:min(ndx + n, l)] for x in batch(range(0, 10), 3): print x Example using list data = [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] # list of data for x in batch(data, … Read more