iterpipes 0.1

Facts

• Enables piping infinite streams through shell pipelines in Python

• Uses standard modules subprocess, threading

• Allows doing things marked as red warning boxes at the subprocess help page

• 0.2 KLOC, tests included

Basic Usage

Pipe 100 000 lines through wc -l and join the resulting iterable into a single string:

>>> from iterpipes import pipe, runpipe
>>> wc = pipe('wc -l')
>>> ''.join(wc('%d\n' % i for i in xrange(100000)))
'100000\n'

Total lines in *.py files under the directory /path/to/dir, use safe shell parameters formatting:

>>> g = runpipe(
...     'find {} -name {} -print0 | xargs -0 wc -l | tail -1 | awk {}',
...     '/path/to/dir', '\*.py', '{print $1}'))
>>> ''.join(g)
'147\n'

Download

This is not really a release. Clone the iterpipes repository if you are interested in following the library.