Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue of nan Reconstruction loss when hidden layer is of dimension 1000 #62

Open
ayushgarg1804 opened this issue Dec 18, 2017 · 0 comments

Comments

@ayushgarg1804
Copy link

When I run the following command from command line, I get reconstruction loss of nan

python run_deep_autoencoder.py --rbm_layers 1000 --batch_size 10 --rbm_num_epochs 30 --verbose 1 --finetune_learning_rate 0.1 --finetune_num_epochs 50 --opt momentum --learning_rate 0.05 --enc_act_func sigmoid --dec_act_func sigmoid --loss_func mse --finetune_act_func sigmoid --rbm_noise gauss

I noticed this only occurs if hidden layer dimensions are more than visible feature dimensions.

@ayushgarg1804 ayushgarg1804 changed the title Issue of nan Reconstruction loss when hidden layer unit is of dimension 1000 Issue of nan Reconstruction loss when hidden layer is of dimension 1000 Dec 18, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant