
Mistral's official instruct fine-tuned version of Mixtral 8x22B. It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include:
See benchmarks on the launch announcement hereOpens in new tab. #moe
| $2.00 | $6.00 | $0.20 | 0.32s | 96 tps | ||
| $2.00 | $6.00 | $0.20 | 0.36s | 95 tps | ||
Not used in Standard routing:Why these endpoints are not used | ||||||
| $2.20 | $6.60 | $0.22 | 0.54s | 24 tps | ||
P50, best across providers
P50, best provider
When an error occurs in an upstream provider, we can recover by routing to another healthy provider, if your request filters allow it. You can access per-provider uptime data programmatically through the Endpoints API. Learn more about our load balancing and customization options.