Code

Leaderboard: Fixed code benchmarks#1441

Code

Merged

x-tabdeveloping merged 9 commits intomainembeddings-benchmark/mteb:mainfrom code_fixembeddings-benchmark/mteb:code_fixCopy head branch name to clipboardNov 13, 2024

+68-37

Commits

Commits on Nov 12, 2024

• fixed code benchmarks

  x-tabdeveloping

  committed
  7fd94f4

  Copy full SHA for 7fd94f4

• fix: Made n_parameters formatting smarter and more robust

  x-tabdeveloping

  committed
  91b1496

  Copy full SHA for 91b1496

• fix: changed jina-embeddings-v3 number of parameters from 572K to 572M

  x-tabdeveloping

  committed
  b4da792

  Copy full SHA for b4da792

• fix: Fixed use_instuctions typo in model overview

  x-tabdeveloping

  committed
  60d7354

  Copy full SHA for 60d7354

• fix: Fixed sentence-transformer compatibility switch

  x-tabdeveloping

  committed
  244ba16

  Copy full SHA for 244ba16

• Ran linting

  x-tabdeveloping

  committed
  afc040e

  Copy full SHA for afc040e

• Added all languages, tasks, types and domains to options

  x-tabdeveloping

  committed
  1f5eb43

  Copy full SHA for 1f5eb43

• Removed resetting options when a new benchmark is selected

  x-tabdeveloping

  committed
  186703b

  Copy full SHA for 186703b

• All results now get displayed, but models that haven't been run on everything get nan values in the table

  x-tabdeveloping

  committed
  0b8698b

  Copy full SHA for 0b8698b