Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Llava models are not consistent in response even after following specified prompt template #111

Open
mathav95raj opened this issue Dec 10, 2024 · 1 comment

Comments

@mathav95raj
Copy link

Model : llava-llama-3-8b-v1_1-int4.gguf
Clip : llava-llama-3-8b-v1_1-mmproj-f16.gguf

According to [docs](https://llmfarm.tech/docs/prompt_format , I set up the prompt template as follows,
[system](You are a helpful, respectful and honest assistant.)

User: {prompt} Describe this image

Assistant:

If I upload the image and type this prompt, I get garbage response. If I do the same after I start with only a text input followed by the image, I get response. Even in the latter, if we upload subsequent images, the response is still of the older one.

image image image
@guinmoon
Copy link
Owner

Hello. Could you please send me prompt options screenshot. It looks like you have an empty first line.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants