Code

SYCL: Kernel function refactor#11515

Code

Closed

qnixsynapse wants to merge 40 commits intoggerganov:masterggerganov/llama.cpp:masterfrom qnixsynapse:refactor_kernelsqnixsynapse/llama.cpp:refactor_kernelsCopy head branch name to clipboard

+2,150-2,114

Commits

Commits on Feb 5, 2025

• SYCL: remove ggml_sycl_op_flatten function

  qnixsynapse

  committed
  2d72bd9

  Copy full SHA for 2d72bd9

• binbcast: use void pointer to prevent intermediate type conversions

  qnixsynapse

  committed
  957c11b

  Copy full SHA for 957c11b

• binbcast: move to a separate file

  qnixsynapse

  committed
  108be39

  Copy full SHA for 108be39

• binbcast: add try catch sycl::exception

  qnixsynapse

  committed
  e1326a7

  Copy full SHA for e1326a7

• Fix GGML_SYCL_DEBUG in kernels in other files

  qnixsynapse

  committed
  fa7c4d8

  Copy full SHA for fa7c4d8

• ARGMAX: move to a separate file

  qnixsynapse

  committed
  95a09ab

  Copy full SHA for 95a09ab

• Argsort: move to a separate file

  qnixsynapse

  committed
  5288bd5

  Copy full SHA for 5288bd5

• ggml_sycl_compute_forward: fixup function calling names and remove comments

  qnixsynapse

  committed
  a153f19

  Copy full SHA for a153f19

• argmax: move missing function to file and fix function name

  qnixsynapse

  committed
  51bedb8

  Copy full SHA for 51bedb8

• argsort: add a space at the end of file

  qnixsynapse

  committed
  3a34659

  Copy full SHA for 3a34659

• Add spaces

  qnixsynapse

  committed
  aaf9ed0

  Copy full SHA for aaf9ed0

• eltwise: sort includes

  qnixsynapse

  committed
  a16b6b7

  Copy full SHA for a16b6b7

• CPY: move to a separate file

  qnixsynapse

  committed
  ecacff3

  Copy full SHA for ecacff3

• eltwise: add back split buffer type checks

  qnixsynapse

  committed
  7d8d689

  Copy full SHA for 7d8d689

• Add back split buffer type checks

  qnixsynapse

  committed
  04d8b03

  Copy full SHA for 04d8b03

• getrows: move to a separate file

  qnixsynapse

  committed
  98f5fd2

  Copy full SHA for 98f5fd2

• diagmask: move to a separate file

  qnixsynapse

  committed
  8e86732

  Copy full SHA for 8e86732

• rope: add try catch sycl exception and debug log

  qnixsynapse

  committed
  7f2d24f

  Copy full SHA for 7f2d24f

• scale: move to a separate file

  qnixsynapse

  committed
  927925f

  Copy full SHA for 927925f

• DUP: move to cpy.cpp, set debug logs and adjust include

  qnixsynapse

  committed
  0c319bf

  Copy full SHA for 0c319bf

• clamp: move to a separate file

  qnixsynapse

  committed
  ddc5e42

  Copy full SHA for ddc5e42

• Add spaces to end of files

  qnixsynapse

  committed
  ba79258

  Copy full SHA for ba79258

• im2col: add try catch block and move wrapper function from ggml-sycl.cpp

  qnixsynapse

  committed
  4db56d6

  Copy full SHA for 4db56d6

• pool2d: move to a separate file

  qnixsynapse

  committed
  eb466d7

  Copy full SHA for eb466d7

• Move sum and sum rows to a separate file

  qnixsynapse

  committed
  5c05a3e

  Copy full SHA for 5c05a3e

• norm: add try catch sycl exception

  qnixsynapse

  committed
  d31c62d

  Copy full SHA for d31c62d

• Add sum to backend hpp

  qnixsynapse

  committed
  1ccfaae

  Copy full SHA for 1ccfaae

• concat: Handle SYCL exceptions

  qnixsynapse

  committed
  bba4b66

  Copy full SHA for bba4b66

• softmax: handle SYCL exceptions and add debug logs

  qnixsynapse

  committed
  6dbb7ac

  Copy full SHA for 6dbb7ac

• norm: add a space at the end of file

  qnixsynapse

  committed
  a6a239c

  Copy full SHA for a6a239c

• Adjust EOF spaces and usused variable

  qnixsynapse

  committed
  6eb30d9

  Copy full SHA for 6eb30d9

• ggml-sycl: sort includes

  qnixsynapse

  committed
  539b0c6

  Copy full SHA for 539b0c6

• gemm.hpp: remove unused include

  qnixsynapse

  committed
  18d706a

  Copy full SHA for 18d706a

• ggml_sycl_op_argmax)Add debug logs to ggml_sycl_mul_ma0

  qnixsynapse

  committed
  0ae9a07

  Copy full SHA for 0ae9a07

• Add back ggml_sycl_set_device to kernels

  qnixsynapse

  committed
  7369e54

  Copy full SHA for 7369e54

• Add remaining SYCL exception handler to kernel and refactor

  qnixsynapse

  committed
  e592637

  Copy full SHA for e592637

• conv: add space before eof

  qnixsynapse

  committed
  52b0652

  Copy full SHA for 52b0652

• Final touches

  qnixsynapse

  committed
  0b602f0

  Copy full SHA for 0b602f0

• ggml-sycl: hide matrix engine info for now from print sycl devices

  qnixsynapse

  committed
  efb5773

  Copy full SHA for efb5773

• Disable non-contiguous tensor support in norm kernels and add newline at the end of debug logs

  qnixsynapse

  committed
  cfa2cc1

  Copy full SHA for cfa2cc1