Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IS on the CUB dataset? #9

Open
qizhongjian opened this issue Jan 12, 2020 · 12 comments
Open

IS on the CUB dataset? #9

qizhongjian opened this issue Jan 12, 2020 · 12 comments

Comments

@qizhongjian
Copy link

I have evaluate the pre-trained model provided by author, but i only got IS 4.62 on CUB. I want know is there any tricks in code?

@qizhongjian
Copy link
Author

I use the batch_size = 3 and only a gpu.

@shangshng
Copy link

Hello, there's the same question for me now. The pre-trained model on CUB shows 4.65 on IS. So do you solve the problem now?

@qizhongjian
Copy link
Author

@shangshng no idea,now.

@MinfengZhu
Copy link
Owner

MinfengZhu commented Sep 30, 2020

Hi, @shangshng @qizhongjian

Could you please show your configurations ( batch size, branch number, and pytorch version).
I generate about 30,000 images using batch size = 3 and branch number = 3. I get 4.69 std: 0.07 on CUB dataset.

Besides, have your tried batch size = 10?

@WhereISmyroad
Copy link

Hi, @shangshng @qizhongjian

Could you please show your configurations ( batch size, branch number, and pytorch version).
I generate about 30,000 images using batch size = 3 and branch number = 3. I get 4.69 std: 0.07 on CUB dataset.

Besides, have your tried batch size = 10?

Hello, I'm using pip install torch==0.4.2
Will it affect the result?

@WhereISmyroad
Copy link

I use CUDA Version:10.1 ,and there is no error when running code, but will it affect the result? I get IS 4.63 on CUB,too...

@MinfengZhu
Copy link
Owner

I use CUDA Version:10.1 ,and there is no error when running code, but will it affect the result? I get IS 4.63 on CUB,too...

How about other evaluation metrics (R and FID) ?

@WhereISmyroad
Copy link

I use CUDA Version:10.1 ,and there is no error when running code, but will it affect the result? I get IS 4.63 on CUB,too...

How about other evaluation metrics (R and FID) ?

Thanks for your reply.
I get 20 in FID, and I don't know how to calculate the R precision, Can you help me about that...
Thanks again!

@WhereISmyroad
Copy link

I use CUDA Version:10.1 ,and there is no error when running code, but will it affect the result? I get IS 4.63 on CUB,too...

How about other evaluation metrics (R and FID) ?

Hello sir
I train the DM Model in my computer.. and When epoch approaches 150,the images generated by G are very similar, is that model collapse?should I train more or do some change in parameter?
(batch size:10 branch num: 3 D&G LR: 0.0002)
Thanks

@MinfengZhu
Copy link
Owner

I use CUDA Version:10.1 ,and there is no error when running code, but will it affect the result? I get IS 4.63 on CUB,too...

How about other evaluation metrics (R and FID) ?

Thanks for your reply.
I get 20 in FID, and I don't know how to calculate the R precision, Can you help me about that...
Thanks again!

The source code will calculate the R precision when you evaluate the model.
python main.py --cfg cfg/eval_bird.yml --gpu 0
Currently, we do not support evaluate R precision during training.

@MinfengZhu
Copy link
Owner

I use CUDA Version:10.1 ,and there is no error when running code, but will it affect the result? I get IS 4.63 on CUB,too...

How about other evaluation metrics (R and FID) ?

Hello sir
I train the DM Model in my computer.. and When epoch approaches 150,the images generated by G are very similar, is that model collapse?should I train more or do some change in parameter?
(batch size:10 branch num: 3 D&G LR: 0.0002)
Thanks

I have no idea have to address this issue. Is there anything you modified? Maybe you can try running this code on other hardware...

@WhereISmyroad
Copy link

I have no idea have to address this issue. Is there anything you modified? Maybe you can try running this code on other hardware...

Thanks for your suggestion.
I found that the graphics card will affect the results. Which version of GPU you are using (I used 1080ti)
Thanks again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants