| Model | Endpoint | Requests | P99 Latency | Errors | Status | |
|---|---|---|---|---|---|---|
| prism-40b | /v1/chat | 847,210 | 186 ms | 0.08% | Healthy | ··· |
| prism-7b | /v1/generate | 623,440 | 94 ms | 0.15% | Healthy | ··· |
| prism-40b-rag | /v1/retrieve | 412,890 | 238 ms | 0.22% | Degraded | ··· |
| prism-embed-v2 | /v1/embed | 389,120 | 38 ms | 0.03% | Healthy | ··· |
| prism-7b-ft | /v1/chat | 156,780 | 168 ms | 0.31% | Degraded | ··· |
| prism-40b | /v1/summarize | 98,430 | 245 ms | 0.09% | Healthy | ··· |