Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase the number of epochs implies in multiply the dataset size #3

Open
eduamf opened this issue Jul 8, 2020 · 0 comments
Open

Comments

@eduamf
Copy link
Contributor

eduamf commented Jul 8, 2020

Increase the number of epochs implies in multiply the dataset size. I need to work with the previous version, using Tensorflow v1, because I need to interact each step each epoch. I changed the program reinitializing the dataset iterator (dataset.iterator_initializer) each epoch change. The problem is that I had no success to update epoch at each iterator initializing without increase the dataset.

I tried setting an operator, including a variable in database property class named epoch, including a placeholder ...
I tried including an argument epoch in word2vec.train ... it is possible to see in github. Word2vec class only know that it is another epoch through dataset, but this is not good, because the batch is not synchronized with dataset size.
I tried something sending operator feed without success.

Can you give an idea. The structure is:

....
for epoch in range(!, epochs+1):
   sess.run(dataset.iterator_initializer)
   while True:      
      try:
          sess.run( ... , feed_dict={ epoch: epoch} )
          result_dict = sess.run(to_be_run_dict)
          ...

I tried to start with 20 epochs, The text file is big, all data of Eur-Lex in 2012 in Portuguese. After 2 hours and half, the session do not started. Using Linux 16.06, 22GB of RAM, Tensorflow 1.15. It never spend so much time. It is still running now while I was writing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant