Option to continue running tests after one fails

Currently, testing is stopped whenever anything fails. Should we add the option to allow testing to continue? Maybe onto the next test group? Or maybe allow continuation after specific tests/groups?

I'm personally leaning towards no, as this could potentially lead to bad deploys. I'm curious as to what others think.