Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat:support any num_heads for get_alibi_slope (flashinfer-ai#200)
When I was using flashinfer, I encountered that the heads of some models were not powers of 2. I refer to **flashinfer/python/tests/alibi_reference.py**, modifies this part of the C++ code.
- Loading branch information