[link](http://scikit-learn.org/stable/) Might be easier than rolling our own. It appears to already have a [dataset](http://scikit-learn.org/stable/modules/generated/sklearn.datasets.load_digits.html#sklearn.datasets.load_digits) for recognizing digits.
link
Might be easier than rolling our own.
It appears to already have a dataset for recognizing digits.