[ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang Wang
-
Updated
Jan 6, 2024 - Python
[ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wenqing Zheng, Tianlong Chen, Zhangyang Wang
GraphCON (ICML 2022)
Gradient gating (ICLR 2023)
[CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong Chen, Zhenyu Zhang, Yu Cheng, Ahmed Awadallah, Zhangyang Wang
"Graph Convolutions Enrich the Self-Attention in Transformers!" NeurIPS 2024
A DGL implementation of "DeeperGCN: All You Need to Train Deeper GCNs".
Source code accompanying the paper "Reducing Over-smoothing in Graph Neural Networks Using Relational Embeddings" published in DLG-AAAI’23
This project implements mechanisms to mitigate over-squashing, improving GNN performance on tasks requiring deep Networks.
Implementing node similarity measures into pytorch geometric
Add a description, image, and links to the oversmoothing topic page so that developers can more easily learn about it.
To associate your repository with the oversmoothing topic, visit your repo's landing page and select "manage topics."