Code

Inference Cache#802

Code

Merged

farshidz merged 28 commits intomainlinemarqo-ai/marqo:mainlinefrom li/inference-cachemarqo-ai/marqo:li/inference-cacheCopy head branch name to clipboardApr 23, 2024

+1,105-193

Commits

Commits on Apr 10, 2024

• Finish inference cache

  wanliAlex

  committed
  0d555b8

  Copy full SHA for 0d555b8

Commits on Apr 12, 2024

• Add extra test in vectorise inference cache

  wanliAlex

  committed
  061b2ce

  Copy full SHA for 061b2ce

• Add docstring for abstract cache

  wanliAlex

  committed
  45f26c6

  Copy full SHA for 45f26c6

• Catch mainline

  wanliAlex

  committed
  610fa6b

  Copy full SHA for 610fa6b

• Finish unit tests

  wanliAlex

  committed
  1f1f8a0

  Copy full SHA for 1f1f8a0

• Add requirements for cachetools, readerwriterlock

  wanliAlex

  committed
  3ff8cee

  Copy full SHA for 3ff8cee

• add Reload the module to apply the new environment variables

  wanliAlex

  committed
  2add027

  Copy full SHA for 2add027

• add Reload the module to apply the new environment variables

  wanliAlex

  committed
  1be6057

  Copy full SHA for 1be6057

• Add a warm-up call to concurrency tests

  wanliAlex

  committed
  0fad6c7

  Copy full SHA for 0fad6c7

• Ensure we remove cache after the test cache class

  wanliAlex

  committed
  196168a

  Copy full SHA for 196168a

• Ensure we remove cache after the test cache class

  wanliAlex

  committed
  049b2ee

  Copy full SHA for 049b2ee

• Add a get_available_models() function in s2_inference

  wanliAlex

  committed
  ba377ef

  Copy full SHA for ba377ef

• Remove unnecessary print

  wanliAlex

  committed
  8a1439a

  Copy full SHA for 8a1439a

• Add get_marqo_inference_cache()

  wanliAlex

  committed
  5ea06b1

  Copy full SHA for 5ea06b1

• Change name to _marqo_inference_cache

  wanliAlex

  committed
  90d4ee0

  Copy full SHA for 90d4ee0

• Make available model private module variables

  wanliAlex

  committed
  167288c

  Copy full SHA for 167288c

• Refactor available_models to _available_models

  wanliAlex

  committed
  8d5c06f

  Copy full SHA for 8d5c06f

• Fix tests

  wanliAlex

  committed
  3063d21

  Copy full SHA for 3063d21

Commits on Apr 15, 2024

• Update the Marqo Inference Cache doc

  wanliAlex

  committed
  50bcb2f

  Copy full SHA for 50bcb2f

Commits on Apr 19, 2024

• Merge branch 'mainline' into li/inference-cache

  wanliAlex

  authored
  1c672d7

  Copy full SHA for 1c672d7

Commits on Apr 22, 2024

• Respond to comments

  wanliAlex

  committed
  605a0e0

  Copy full SHA for 605a0e0

• Update vectorise function

  wanliAlex

  committed
  01be581

  Copy full SHA for 01be581

• Fix a unit test

  wanliAlex

  committed
  0c84b50

  Copy full SHA for 0c84b50

• Fix a unit test

  wanliAlex

  committed
  7e675c7

  Copy full SHA for 7e675c7

Commits on Apr 23, 2024

• Add cachetools==5.3.1 to requirements

  wanliAlex

  committed
  5787197

  Copy full SHA for 5787197

• Add cachetools==5.3.1 to requirements

  wanliAlex

  committed
  ecd5d68

  Copy full SHA for ecd5d68

• Catch mainline

  wanliAlex

  committed
  0910c66

  Copy full SHA for 0910c66

• Catch mainline

  wanliAlex

  committed
  8a9a431

  Copy full SHA for 8a9a431