llamaIndex's Vllm support for finetuned Mixtral8x7B GPTQ LLM model

[chjoo7]

I tried the Vllm call using the custom-data-finetuned LLM based on the Mixtral 8X7B Instruct v0.1 GPTQ model. I met the OSError: does not appear to have a fine named confg.json. If my memory is correct, the previous Vllm from LlamaIndex had room to accept the tokenizer argument but the latest Vllm seemed not. In this case, can we guide the Vllm on the base tokenizer path? Sorry, this question seems to go to llama index but see if anyone can help this out...