New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unable to set environment variables - OLLAMA_NUM_PARALLEL, OLLAMA_NUM_GPU, and OLLAMA_NUM_THREAD #402

Open

harshachopra507 opened this issue Dec 31, 2024 · 1 comment

harshachopra507 commented Dec 31, 2024

I have set os.environ["OLLAMA_NUM_PARALLEL"] = "4" through python script, but it is not running parallely 4 LLM requests.

Please help me with this issue.

Contributor

ParthSareen commented Jan 22, 2025

Could you show the snippet of code you're making requests with?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment