Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about your examples #55

Open
mng8 opened this issue Oct 9, 2020 · 3 comments
Open

Question about your examples #55

mng8 opened this issue Oct 9, 2020 · 3 comments

Comments

@mng8
Copy link

mng8 commented Oct 9, 2020

Why do you not use controller hidden or read vectors over time as your perform the task?

@ixaxaar
Copy link
Owner

ixaxaar commented Oct 10, 2020

The examples are from the paper.

Personally, I did use the controller hidden vectors as well as let the memory remain uncleared for entire training time while doing various experiments myself and many other variations of these.

@mng8
Copy link
Author

mng8 commented Oct 11, 2020

Looking at inside the model code, I do see you use the reads and controller hidden vector inside the time iterations

@ixaxaar
Copy link
Owner

ixaxaar commented Oct 11, 2020

Yes, one has to use them within timesteps otherwise the whole thing is just a bunch of vanilla RNNs i think.

What I was talking about is entire training time across batches and epochs, for e.g. using the memory as a global knowledge base of sorts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants