Pre-commit CI

[Feat.] Refactor llm_inference/run.py to use ParallelInferenceManager with batch inference #305

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
pre-commit	1m 12s
MyPy (3.9)	29s
MyPy (3.12)	27s
MyPy (3.10)	23s
MyPy (3.11)	25s
	2m 56s