Commit c5ec7eb8 authored by ale's avatar ale

Add multi-file output

The output stage can now write to size-limited, rotating WARC files
using a user-specified pattern, so that output files are always
unique.
parent 3518feaf
Pipeline #2000 passed with stage
in 22 seconds