Code

gemma2: add sliding window mask#8227

Code

Merged

ngxson merged 10 commits intoggerganov:masterggerganov/llama.cpp:masterfrom ngxson:xsn/gemma2_mask_swangxson/llama.cpp:xsn/gemma2_mask_swaCopy head branch name to clipboardJul 1, 2024

+79-32

Commits

Commits on Jun 30, 2024

• gemma2: add sliding window mask

  ngxson

  committed
  7df7530

  Copy full SHA for 7df7530

• fix data_swa uninitialized

  ngxson

  committed
  ab2c3de

  Copy full SHA for ab2c3de

• better naming

  ngxson

  committed
  46b56e6

  Copy full SHA for 46b56e6

• add co-author

  Show description for 231dae4
  

  ngxson

  and

  arlo-phoenix

  committed
  231dae4

  Copy full SHA for 231dae4

• replace list with single tensor

  ngxson

  committed
  d09ecb8

  Copy full SHA for d09ecb8

Commits on Jul 1, 2024

• update

  ngxson

  committed
  ed5496f

  Copy full SHA for ed5496f

• llama : minor styling

  ggerganov

  committed
  ce711f6

  Copy full SHA for ce711f6

• convert : add sanity check for query_pre_attn_scalar

  ggerganov

  committed
  7dc9cbf

  Copy full SHA for 7dc9cbf

• Merge branch 'master' into xsn/gemma2_mask_swa

  ngxson

  committed
  80bdc38

  Copy full SHA for 80bdc38

• fix small typo in README

  ngxson

  committed
  e24328e

  Copy full SHA for e24328e