Split inference into separate http endpoint. #2658
| Job | Run time |
|---|---|
| 8m 25s | |
| 4m 29s | |
| 11m 9s | |
| 8m 19s | |
| 6m 37s | |
| 10m 52s | |
| 15m 11s | |
| 11m 2s | |
| 6m 53s | |
| 10m 13s | |
| 1h 35m 41s | |
| 9m 15s | |
| 16m 22s | |
| 9m 19s | |
| 16m 41s | |
| 7m 43s | |
| 0s | |
| 4m 44s | |
| 4m 49s | |
| 5m 7s | |
| 2h 12m 45s | |
| 0s | |
| 1h 45m 52s | |
| 3h 44m 36s | |
| 4s | |
| 12h 6m 8s |