Releases: adamdehaven/fetchurls
Releases · adamdehaven/fetchurls
wget --reject-regex
Utilizes wget --reject-regex to filter files.
Handle invalid user input
Updates the $USER_SAVE_LOCATION and $USER_FILENAME back to the default if the user clears out the value during interactive mode.
Removing spaces from spinner
v3.3.1 Removing spaces from spinner
Update grep flows to be case-insensitive
v3.3.0 Fix grep to be case-insensitive for redirects
Changing bang to bin/bash
v3.2.5 Changing bang to bin/bash. Resolves #13
Check for user settings if non-interactive is set.
v3.2.4 Check for user settings if non-interactive is set. Fixes #12.
Fixing line endings
v3.2.3 Fixing line endings
Adding --ignore-robots flag
- Added
-i, --ignore-robotsflag which will ignore therobots.txtfile for the domain.
Fixing 3xx HTTP Status Codes
Splitting out HTTP status checking, fixing an issue with 3xx status codes.
Adding authentication
- Adding
--usernameand-passwordflags for URLs requiring authentication. The values get passed to the underlyingwgetcommand. - Adding
--sleepflag to add delay between retrievals. - Fixes an issue related to option/flag processing.