support using xgrammar to get json output

[MeouSker77]

Description

support using xgrammar to get json output

1. Why the change?

2. User API changes

pip install xgrammar==0.1.13

tokenizer = ...
model = ...
schema = ...

from ipex_llm.transformers.xgrammar import create_json_logits_processor, reset_json_logits_processor

json_processor = create_json_logits_processor(tokenizer, model.config.vocab_size, schema)

for prompt in [prompts]:
    input_ids = tokenizer.apply_chat_template(prompt, return_tensors="pt", add_generation_prompt=True)
    json_processor = reset_json_logits_processor(json_processor)
    model.generate(
        input_ids,
        ...
        logits_processor=[json_processor]
    )