-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Colab problem: continue previous training #396
Comments
@olaviinha Hi, having the same warning -not only on colab though. A quick workaround for restoring the model properly is to set the --logdir arg to the dir where your model was saved, and not use --restore_from. However I cannot figure out the warning! back in April I trained with tf 1.3 and everything was ok.. I suspect that between versions 1.3 --> 1.15(the one that's on colab) there have been changes to the Saver class. So I'm looking into that.. |
@ileanna hi! --logdir is an argument of which method? I am doing
but it wont work... |
@nschmidtg hello! as --logdir specifies the directory where train logs are stored you need to point to a folder. So in your case it should be I hope it works like this! |
Thanks! It did work! |
I am using Colab (w/
%tensorflow_version 1.x
) to run it and Google Drive to store all the related data.It starts training from step 0 every time (along with a bunch of warnings) despite seemingly finding and restoring a previous checkpoint correctly in the beiginning.
Has anybody had any luck in continuing previous training in Colab?
The text was updated successfully, but these errors were encountered: