From man python: -u Force stdin, stdout and stderr to be totally unbuffered. On systems where it matters, also put stdin, stdout and stderr in binary mode. Note that there is internal buffering in xreadlines(), readlines() and file- object iterators (“for line in sys.stdin”) which is not influenced by this option. To work around this, … Read more
use split: my_program | tee >(split -d -b 100000 -) Or if you don’t want to see the output, you can directly pipe to split: my_program | split -d -b 100000 – As for the log rotation, there’s no tool in coreutils that does it automatically. You could create a symlink and periodically update it … Read more
Perhaps you could put the exit value from PIPESTATUS into $? command 2>&1 | tee -a file.txt ; ( exit ${PIPESTATUS} )
Another way (assuming a shell like bash or zsh): echo “hey hey, we’re the monkees” | tee >(gzip –stdout > my_log.gz) The admittedly strange >() syntax basically does the following: Create new FIFO (usually something in /tmp/) Execute command inside () and bind the FIFO to stdin on that subcommand Return FIFO filename to command … Read more
It should be ok if you use both tee and mkfifo. mkfifo pipe cat pipe | (command 1) & echo ‘test’ | tee pipe | (command 2)
Here’s a simpler way of reproducing your issue: $ cat foo.py from time import sleep while True: sleep(2) print “hello” $ python foo.py hello hello (…) $ python foo.py | tee log (no output) This happens because python buffers stdout when it’s not a terminal. The easiest way to unbuffer it is to use python … Read more
The only cross platform method I found which works in both interactive and non-interactive shells is: command | tee >(cat 1>&2) The argument to tee is a file or file handle. Using process substitution we send the output to a process. In the process =cat=, we redirect stdout to stderr. The shell (bash/ksh) is responsible … Read more
I see that this is a rather old post but just in case someone is still searching for a way to do this: proc = subprocess.Popen([“ping”, “localhost”], stdout=subprocess.PIPE, stderr=subprocess.PIPE) with open(“logfile.txt”, “w”) as log_file: while proc.poll() is None: line = proc.stderr.readline() if line: print “err: ” + line.strip() log_file.write(line) line = proc.stdout.readline() if line: print … Read more
Duplicate &1 in your shell (in my example to 5) and use &5 in the subshell (so that you will write to stdout (&1) of the parent shell): exec 5>&1 FF=$(echo aaa|tee >(cat – >&5)) echo $FF This will print “aaa” two times, once because of the echo in the subshell, and the second time … Read more
From man python: -u Force stdin, stdout and stderr to be totally unbuffered. On systems where it matters, also put stdin, stdout and stderr in binary mode. Note that there is internal buffering in xreadlines(), readlines() and file- object iterators (“for line in sys.stdin”) which is not influenced by this option. To work around this, … Read more