[BUG] Fix gemma 2 flash attention 2

[Boubou78000]

There was a bug line 815:

It was using the version library and, using the version function argument.

AttributeError: 'str' object has no attribute 'parse'

[tanliboy]

I got the same problem while trying to fine-tune Gemma 2 with the latest flash-attn. Thanks for fixing it!

[Boubou78000]

I got the same problem while trying to fine-tune Gemma 2 with the latest flash-attn. Thanks for fixing it!

I just fixed ONE of the problem.
There are more 😭

[vanilladucky]

Hi, I saw this case as being closed and was wondering if this bug not going to get fixed? My implementation with flash attention for Gemma 2 is not working because of this problem.

I was using the flash attention library v==2.6.1

[Boubou78000]

Hi, I saw this case as being closed and was wondering if this bug not going to get fixed? My implementation with flash attention for Gemma 2 is not working because of this problem.

I was using the flash attention library v==2.6.1

1. Install the dev version from source
2. Not the end of the problems

[vanilladucky]

Ah yes, managed to get it fixed, thank you very much!

[thepowerfuldeez]

Hi everyone! Can't find the fix for that in the latest main, nor in the discussion from the link above. Why this PR is closed?

[thepowerfuldeez]

UPD: found update in main