Code

token healing impl#29081

Code

Closed

ahmed-moubtahij wants to merge 9 commits intohuggingface:mainhuggingface/transformers:mainfrom ahmed-moubtahij:heal_tokensCopy head branch name to clipboard

+220-3

Commits

Commits on Feb 20, 2024

• token healing impl

  ahmed-moubtahij

  committed
  d17584e

  Copy full SHA for d17584e

Commits on Feb 28, 2024

• token healing impl

  

  ahmed-moubtahij

  authored and

  gante

  committed
  fb8f187

  Copy full SHA for fb8f187

• empty_commit

  

  ydshieh

  authored and

  gante

  committed
  2a146b6

  Copy full SHA for 2a146b6

• merge requirements

  gante

  committed
  07fa23f

  Copy full SHA for 07fa23f

• fix requirements

  gante

  committed
  762ebb9

  Copy full SHA for 762ebb9

• tokenizer as an input

  gante

  committed
  c777787

  Copy full SHA for c777787

Commits on Mar 5, 2024

• Merge branch 'main' into heal_tokens

  gante

  authored
  249a8f7

  Copy full SHA for 249a8f7

Commits on Mar 8, 2024

• Merge branch 'heal_tokens' of github.com:Ayenem/transformers into heal_tokens

  ahmed-moubtahij

  committed
  43cb7ce

  Copy full SHA for 43cb7ce

• protected pygtrie import

  ahmed-moubtahij

  committed
  27d3ca0

  Copy full SHA for 27d3ca0