Run Mistral 7B Instruct with an API | Clarifai Blog
Mistral 7B is a 7.3B parameter model from Mistral AI that outperformed Llama 2 13B on all Benchmarks and Llama 34B on many benchmarks and approaches CodeLlama 7B performance on code.
Contents
- Mistral 7B Instruct
- Running Mistral 7B Instruct with Python
- Mistral 7B Instruct Model Demo
- Mistral 7B vs Llama 2
Mistral 7B Instruct: Fine-Tuning for Chat
Mistral 7B is finetuned on publicly available instruction datasets resulting in Mistral 7B Instruct Model. It achieves remarkable performance, outperforming all other 7B models on MT-Bench and is comparable to 13B chat models.
Running Mistral 7B Instruct with Python
You can run Mistral 7B Instruct with our Python SDK with just a few lines of code.
To get started, Signup to Clarifai here and get your Personal Access Token(PAT) under security section in settings.
Check out the Code Below:
You can also run the Mistral 7B Instruct model with the Clarifai Python API Client.
Check out the Code Below:
You can also run Mistral 7B Instruct Model using the other Clarifai Client Libraries like Javascript, Java, cURL, NodeJS, PHP, etc here.
Model Demo in the Clarifai Platform:
Try out the Mistral 7B Instruct model here: clarifai.com/mistralai/completion/models/mistral-7B-Instruct.
Mistral 7B vs Llama 2
Mistral 7B was evaluated with the performance of various Llama models across a wide range of benchmarks.
- Mistral 7B Dominance: Mistral 7B stands out by significantly outperforming Llama 2 13B across all metrics.
- Comparable to Llama 34B: Since there is no Llama 2 34B version available Mistral 7B's performance is compared with Llama 34B and it's on par.
- Code and Reasoning: Mistral 7B also excels in code-related and reasoning benchmarks and it's approaches CodeLlama 7B performance on code.