Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars & minimalist Jinja engine #17954
| Job | Run time |
|---|---|
| 11m 32s | |
| 12m 9s | |
| 1m 7s | |
| 1m 16s | |
| 4m 17s | |
| 1m 41s | |
| 1m 38s | |
| 13m 2s | |
| 1m 43s | |
| 12m 26s | |
| 5m 22s | |
| 5m 11s | |
| 13m 11s | |
| 3m 9s | |
| 2m 56s | |
| 3m 46s | |
| 6m 56s | |
| 3m 17s | |
| 1m 16s | |
| 5m 28s | |
| 4m 22s | |
| 9m 56s | |
| 4m 21s | |
| 3m 11s | |
| 4m 0s | |
| 3m 23s | |
| 1s | |
| 2m 0s | |
| 12m 54s | |
| 5m 16s | |
| 3m 49s | |
| 1m 45s | |
| 5m 8s | |
| 1s | |
| 5m 8s | |
| 1m 46s | |
| 1s | |
| 5s | |
| 0s | |
| 1s | |
| 1s | |
| 0s | |
| 2h 58m 32s |