Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ADD] add skip layernorm to kernel explorer for ROCm EP #12816

Merged
merged 14 commits into from
Sep 20, 2022

Conversation

PeixuanZuo
Copy link
Contributor

@PeixuanZuo PeixuanZuo commented Sep 1, 2022

Description: Describe your changes.
Related PR: #12803 #12817 #12821

Add skip layernorm to kernel explorer for profiling.

Motivation and Context

  • Why is this change required? What problem does it solve?
  • If it fixes an open issue, please link to the issue here.

@PeixuanZuo PeixuanZuo changed the title [Add] add skip layernorm to kernel explorer for ROCm EP [ADD] add skip layernorm to kernel explorer for ROCm EP Sep 1, 2022
@lgtm-com
Copy link

lgtm-com bot commented Sep 1, 2022

This pull request introduces 2 alerts when merging eb047b5 into 3a55694 - view on LGTM.com

new alerts:

  • 2 for Variable defined multiple times

Base automatically changed from peixuanzuo/fix_skip_layer_norm to main September 15, 2022 16:07
@PeixuanZuo PeixuanZuo force-pushed the peixuanzuo/add_ke_skiplayernorm branch from b7fdf1e to f0de88b Compare September 19, 2022 09:45
zhangyaobit
zhangyaobit previously approved these changes Sep 19, 2022
@PeixuanZuo PeixuanZuo merged commit 189aef2 into main Sep 20, 2022
@PeixuanZuo PeixuanZuo deleted the peixuanzuo/add_ke_skiplayernorm branch September 20, 2022 09:17
PeixuanZuo added a commit that referenced this pull request Sep 23, 2022
**Description**: Describe your changes.
Related PR: #12803
#12816
#12821

1.add tunable skip layernorm for rocm ep
2. keep origin implementation when disable tuning.

**Motivation and Context**
- Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here.
linnealovespie pushed a commit that referenced this pull request Sep 30, 2022
**Description**: Describe your changes.
Related PR: #12803
#12817
#12821

Add skip layernorm to kernel explorer for profiling.

**Motivation and Context**
- Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here.
linnealovespie pushed a commit that referenced this pull request Sep 30, 2022
**Description**: Describe your changes.
Related PR: #12803
#12816
#12821

1.add tunable skip layernorm for rocm ep
2. keep origin implementation when disable tuning.

**Motivation and Context**
- Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants