Update the deduplication codes to install deps from Conda

REDIS is a requirement for the deduplication efforts. However REDIS server is a nuisance to install on HPC systems. The easy solution here is to switch to using Conda for all our dependencies since conda does a decent job of getting binary packages installed.