Pre-commit CI

[Feat.] Refactor llm_inference/run.py to use ParallelInferenceManager with batch inference #311

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
pre-commit	1m 4s
MyPy (3.10)	27s
MyPy (3.11)	25s
MyPy (3.12)	30s
MyPy (3.9)	31s
	2m 57s