SUPPORT_MODEL.md

Supported models

The table below represents the current support in the library for each of those models, whether they have support in Pynative mode or Graph mode.

Model	Pynative support	Graph Support
ALBERT	✅	✅
ALIGN	✅	❌
AltCLIP	✅	❌
Audio Spectrogram Transformer	✅	❌
Autoformer	✅ (Inference only)	❌
BaiChuan	✅	❌
Bark	✅	❌
BART	✅	❌
Barthez	✅	❌
Bartpho	✅	❌
BEIT	✅	❌
BERT	✅	❌
BERT Generation	✅	❌
BERT Japanese	✅	❌
BERTweet	✅	❌
BGE M3	✅	❌
Bigbird	✅	❌
Bigbird Pegasus	✅	❌
BioGPT	✅	❌
Bit	✅	❌
Blenderbot	✅	❌
BLIP	TODO	❌
BLIP2	TODO	❌
BLOOM	✅	❌
ChatGLM	✅	❌
ChatGLM2	✅	❌
ChatGLM3	✅	❌
CLIP	✅	❌
CodeGen	✅	❌
ConvBERT	TODO	❌
CPM	✅	❌
CPM-Ant	✅	❌
CPM-Bee	✅	❌
MiniCPM	✅	❌
Deberta	✅	❌
Electra	TODO	❌
EnCodec	✅	❌
ERNIE	✅	✅
ERNIEM	✅	✅
ESM	✅	❌
Falcon	✅	❌
OpenAI GPT	✅	❌
OpenAI GPT-2	✅	✅
Gemma	✅	❌
GPT Neo	✅	❌
GPT NeoX	TODO	❌
GPT Pangu	✅	❌
GPTBigCode	✅	❌
Graphormer	✅	❌
Hubert	✅	❌
Jamba	✅	❌
Llama	✅	❌
Llama2	✅	❌
CodeLlama	✅	❌
Longformer	✅	❌
LongT5	✅	❌
LUKE	✅	❌
MaskFormer	✅	❌
Mamba	✅	❌
mBART-50	✅	❌
Megatron-BERT	✅	❌
Megatron-GPT2	✅	❌
Mistral	✅	❌
Mixtral	✅	❌
MobileBERT	✅	❌
Moss	✅	❌
MusicGen	✅	❌
MusicGen Melody	✅	❌
Nezha	✅	❌
OPT	✅	❌
Phi2	✅	❌
Pop2piano	✅	❌
Qwen2	✅	❌
Qwen2Moe	✅	❌
Reformer	✅	❌
RegNet	Todo	❌
RoBERTa	✅	✅
RWKV	✅	❌
SeamlessM4T	✅	❌
SeamlessM4Tv2	✅	❌
StarCoder	✅	❌
T5	✅	❌
Timesformer	TODO	❌
Tinybert	✅	❌
wav2vec	✅	❌
Whisper	✅	❌
XLM	✅	❌
XLM-RoBERTa	✅	❌