Centralize config file reading

The config file is currently being read in multiple places. Apart from being unclean, it may also introduce bugs as we don't validate inputs, causing weird crashes in random places that end users will not be able to understand.

We can also investigate using https://github.com/davidtheclark/cosmiconfig.