
A 12B parameter model with a 128k token context length built by Mistral in collaboration with NVIDIA.
The model is multilingual, supporting English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese, Korean, Arabic, and Hindi.
It supports function calling and is released under the Apache 2.0 license.
| $0.018 | $0.03 | -- | 0.51s | 18 tps | ||
| $0.019 | $0.03 | -- | 0.82s | 26 tps | ||
| $0.03 | $0.03 | -- | 0.56s | 42 tps | ||
19% off | $0.044$0.03564 | $0.16$0.1296 | $0.029$0.02349 | 0.33s | 15 tps | |
| $0.04 | $0.17 | -- | 0.55s | 42 tps | ||
Not used in Standard routing:Why these endpoints are not used | ||||||
| $0.15 | $0.15 | $0.015 | 0.55s | 27 tps | ||
P50, best across providers
P50, best provider
When an error occurs in an upstream provider, we can recover by routing to another healthy provider, if your request filters allow it. You can access per-provider uptime data programmatically through the Endpoints API. Learn more about our load balancing and customization options.