Skip to content
Snippets Groups Projects
  1. Feb 17, 2020
    • ale's avatar
      Propagate the link tag through redirects · 533f4725
      ale authored
      In order to do this we have to plumb it through the queue and the
      Handler interface, but it should allow fetches of the resources
      associated with a page via the IncludeRelatedScope even if it's behind
      a redirect.
      533f4725
  2. Aug 31, 2018
    • ale's avatar
      Improve error checking · ee1a3d8e
      ale authored
      Detect write errors (both on the database and to the WARC output) and
      abort with an error message.
      
      Also fix a bunch of harmless lint warnings.
      ee1a3d8e
  3. Dec 19, 2017
  4. Dec 18, 2017
  5. Jun 29, 2015
    • ale's avatar
      improve queue code; golint fixes · 9fbc656c
      ale authored
      The queuing code now performs proper lease accounting, and it will not
      return a URL twice if the page load is slow.
      9fbc656c
Loading