Skip to content
Snippets Groups Projects
Commit bbc09df4 authored by ale's avatar ale
Browse files

Fix typo

parent 59f3725f
No related branches found
No related tags found
No related merge requests found
......@@ -62,7 +62,7 @@ Like most crawlers, this one has a number of limitations:
* it completely ignores *robots.txt*. You can make such policy
decisions yourself by turning the robots.txt into a list of patterns
to be used with *--exclude-file*.
to be used with *--exclude-from-file*.
* it does not embed a Javascript engine, so Javascript-rendered
elements will not be detected.
* CSS parsing is limited (uses regular expressions), so some *url()*
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment