• ale's avatar
    Mention trickle as a possible bandwidth limiter · 86a0bd2d
    ale authored
    Since such bandwidth limiting is not provided by crawl directly, tell
    users there is another solution. Once/if crawl implements that on its
    own, that notice could be removed.
    86a0bd2d
Name
Last commit
Last update
analysis Loading commit data...
cmd Loading commit data...
vendor Loading commit data...
warc Loading commit data...
.gitlab-ci.yml Loading commit data...
LICENSE Loading commit data...
README.md Loading commit data...
client.go Loading commit data...
crawler.go Loading commit data...
crawler_test.go Loading commit data...
gen-ignores.py Loading commit data...
ignore_patterns.go Loading commit data...
queue.go Loading commit data...
scope.go Loading commit data...
scope_test.go Loading commit data...