New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Research] Explore tree sparsity (speed +10%-20%) #34

Closed

Tracked by

ctlllll opened this issue Sep 18, 2023 · 0 comments

Closed

Tracked by

[Research] Explore tree sparsity (speed +10%-20%) #34

ctlllll opened this issue Sep 18, 2023 · 0 comments

Assignees

Labels

Contributor

ctlllll commented Sep 18, 2023 •

edited

Loading

Further acceleration by using a sparse tree attention. Expecting a 10%-20% performance improvement. Credit: @leeyeehoo

ctlllll mentioned this issue

Open

14 tasks

ctlllll changed the title ~~Explore tree sparsity~~ [Research] Explore tree sparsity

ctlllll assigned leeyeehoo

ctlllll added the research label

ctlllll mentioned this issue

Sparse tree #42

Merged

ctlllll closed this as completed

ctlllll changed the title ~~[Research] Explore tree sparsity~~ [Research] Explore tree sparsity (speed +10%-20%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment