Skip to content

Tools

pipelino

Give your async work a sense of flow.

pipelino is a staged pipeline for async work, in the browser and in Node. You write the stages; pipelino moves every item through them, with per-stage concurrency, batching, pause and cancel, and live progress. Zero dependencies, 2.6 kB gzipped. Open source under the MIT licence.

Screenshot
Stages, not queues
One object describes the whole flow. Items move from stage to stage on their own.
Results merge into the item
Return an object from a stage and its fields are assigned to the item: no second data structure to keep in sync.
Streaming or barrier
An item enters the next stage the moment it leaves the previous one, unless that stage is a barrier, which waits until no item is still behind it.
Batching by count and weight
Ready items are grouped by number or by weight, bytes for example. A batch never waits to fill up.
Control while it runs
Pause, resume, cancel with an AbortSignal, remove items, push more or append stages.
Live progress
Progress events per stage and overall, ready to drive a progress bar.