Add persistent collections
In this mode, we can connect to a persistent collection as input and skip the expensive "load in memory" stage. When this happens, we assume we're no longer in "shell pipeline" mode, and disable output automatically.
The "convert-metadata" tool can be used to load data into a persistent collection when necessary.