-
Notifications
You must be signed in to change notification settings - Fork 3.5k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[CUDNN] Support gradient kernels (#9986)
* Dgrad nchw, nhwc, fp16 working commit 426e5dc Author: Masahiro Masuda <masahi129@gmail.com> Date: Tue Jan 18 11:48:53 2022 +0900 black commit 211a58b Author: Masahiro Masuda <masahi129@gmail.com> Date: Tue Jan 18 11:43:52 2022 +0900 fp16 also works commit c2a34d4 Author: Masahiro Masuda <masahi129@gmail.com> Date: Tue Jan 18 11:36:36 2022 +0900 nhwc test also worked commit c0609ab Author: Masahiro Masuda <masahi129@gmail.com> Date: Tue Jan 18 11:21:23 2022 +0900 nchw test worked commit 2bf68c7 Author: Masahiro Masuda <masahi129@gmail.com> Date: Tue Jan 18 10:41:35 2022 +0900 add test stub commit c86b128 Author: Masahiro Masuda <masahi129@gmail.com> Date: Tue Jan 18 10:32:09 2022 +0900 add python definition stub commit 3166952 Author: Masahiro Masuda <masahi129@gmail.com> Date: Tue Jan 18 06:57:18 2022 +0900 bwd filter compiled commit e311ba3 Author: Masahiro Masuda <masahi129@gmail.com> Date: Tue Jan 18 06:27:55 2022 +0900 dgrad compiled commit 47f35be Author: Masahiro Masuda <masahi129@gmail.com> Date: Tue Jan 18 06:16:43 2022 +0900 add dgrad stub commit ebed032 Author: Masahiro Masuda <masahi129@gmail.com> Date: Mon Jan 17 17:01:56 2022 +0900 cpplint commit 834f54a Author: Masahiro Masuda <masahi129@gmail.com> Date: Mon Jan 17 16:55:58 2022 +0900 remove cudnn get output commit dcbd9c9 Author: Masahiro Masuda <masahi129@gmail.com> Date: Mon Jan 17 16:28:07 2022 +0900 more refactor commit 146464e Author: Masahiro Masuda <masahi129@gmail.com> Date: Mon Jan 17 15:57:35 2022 +0900 Introduce SetConvdescriptors to refactor cudnn/conv_forward.cc * add python function for cudnn wgrad * adding wgrad test * black * wgrad nchw and nhwc worked * remove bwd algo name stuff * compute output shape properly * swap arg order in wgrad * add kernel size arg in test * black * cleanup * more fix * fix dgrad test * support running relay conv2d_backward_weight directly with cudnn * black * refactor reference function to support nhwc * removed unused function * lint * enable offloading conv2d_transpose to cudnn dgrad * relax tol * name fix, remove print
- Loading branch information
Showing
17 changed files
with
996 additions
and
74 deletions.
There are no files selected for viewing
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.