Commits · 4c82422d2e75b9b8f4d034b1f43fda566416d6af · ale / crawl

Dec 20, 2014
- make Scope checking more modular · 4c82422d
  ale authored 10 years ago
  
  4c82422d
- relax the CSS url() regexp · efe98903
  ale authored 10 years ago
  
  efe98903
- move link extraction to a common location · f0c14e5e
  ale authored 10 years ago
  
  f0c14e5e
- move the WARC code into its own package · d4c561c2
  ale authored 10 years ago
  
  Now generates well-formed, indexable WARC files.
  d4c561c2
Dec 19, 2014
- initial commit · b09f05f8
  ale authored 10 years ago
  
  b09f05f8