crawler-add should ignore blank lines #58
Description
When reading URIs from standard input, crawler-add should silently skip blank lines. Currently it attempts (but fails) to add an empty URI instead:
crawler-add: Error: %ANANSI-E-5004: failed to derive root from URI <>
crawler-add: Error: %ANANSI-E-2002: failed to add URI to crawl queue <> at stdin:35