I did some work to relax the requirements for tensorforce, but it resulted in some deep tensorflow errors. Took a while of digging, but in the end I'm not the only person finding this to be problematic. I think this issue will block supporting python 3.10...
tensorforce/tensorforce#889