1. 20 Jan, 2019 1 commit
  2. 19 Jan, 2019 1 commit
    • ale's avatar
      Replace URLInfo with a simple URL presence check · cce28f44
      ale authored
      The whole URLInfo structure, while neat, is unused except for the
      purpose of verifying if we have already seen a specific URL.
      
      The presence check is also now limited to Enqueue().
      cce28f44
  3. 02 Jan, 2019 1 commit
    • ale's avatar
      Add multi-file output · c5ec7eb8
      ale authored
      The output stage can now write to size-limited, rotating WARC files
      using a user-specified pattern, so that output files are always
      unique.
      c5ec7eb8
  4. 28 Dec, 2018 1 commit
  5. 27 Dec, 2018 2 commits
  6. 06 Dec, 2018 1 commit
  7. 02 Sep, 2018 4 commits
  8. 31 Aug, 2018 7 commits
  9. 30 Aug, 2018 3 commits
  10. 19 Dec, 2017 11 commits
  11. 18 Dec, 2017 5 commits
  12. 03 Jul, 2015 1 commit
  13. 29 Jun, 2015 2 commits