Code

Fix backward rope after YaRN#3974

Code

Merged

ggerganov merged 6 commits intoggerganov:masterggerganov/llama.cpp:masterfrom xaedes:fix-backward-rope-after-yarnxaedes/llama.cpp:fix-backward-rope-after-yarnCopy head branch name to clipboardNov 7, 2023

+84-253

Commits

Commits on Nov 6, 2023

• fix backward process of rope

  Show description for ff0a364
  xaedes

  committed
  ff0a364

  Copy full SHA for ff0a364

• fix finetune rope call to use correct default attn_factor of 1.0f

  xaedes

  committed
  93e65d3

  Copy full SHA for 93e65d3

• remove unused ggml_rope_xpos_back

  Show description for 926930b
  xaedes

  committed
  926930b

  Copy full SHA for 926930b

• fix comments explaining the sinus sign in ggml_forward_rope

  xaedes

  committed
  3490a17

  Copy full SHA for 3490a17

• add missing function arguments in declaration

  xaedes

  committed
  ad83e41

  Copy full SHA for ad83e41

• fix function argument type in declaration

  xaedes

  committed
  a352d40

  Copy full SHA for a352d40