offline training #4
Description
Hi! Is offline training now fully supported? I am confused because I see the train_offline script but in the README I see that you say that offline training is not implemented. Maybe not with the D4RL dataset, but should it work for any dataset of experiences (s,a,r,s',d)?
Thank you!