Thanks Samy,

Yes I also face those limitations., This is part of the motivation. I want my experiments to be written so that if I run out of compute, I can simply restart them later and continue training.