Implementing controllabale text generation with diffusion for HuggingFace JAX/Diffusers community sprint.
References:
paper https://arxiv.org/pdf/2205.14217.pdf
code https://github.com/XiangLi1999/Diffusion-LM
minimal implementation https://github.com/madaan/minimal-text-diffusion
-
add sprint-related requirements (docstring, push to hub)
-
add evaluation
-
[x ] add inference pipeline
-
add reloading model to continue training
-
add training stopping criteria
-
[ x] add other datasets
-
add different tokenizers (SP)
-
[ x] add other padding modes (only block now)