[Model Request] Falcon

[juwalter]

⚙️ Request New Models

• Link to an existing implementation (e.g. Hugging Face/Github): https://huggingface.co/blog/falcon
• Is this model architecture supported by MLC-LLM?
  • A: I cannot determine if the model architecture in general would work

In general, Falcon is leading the truly open source LLM, and it would be fantastic to have it supported by mlc-llm

[MasterJH5574]

Hi @juwalter, we are currently working on adding Falcon support and it is expected to be up soon. Please stay tuned :-)

[juwalter]

wow, that is great!! really looking forward to it :)

[m1chae1bx]

Hello, is there any update to this?

[ftrojan]

Also interested in Falcon support in MLC-LLM. Can help if need be.

[masahi]

What's the status of Falcon support? @MasterJH5574

[PabloButron]

Hi @juwalter, we are currently working on adding Falcon support and it is expected to be up soon. Please stay tuned :-)

Hello, does this will work with the new falcon 3?