Mistral-7B-Instruct

A 7B parameter instruction-tuned model with Apache 2.0 licence, considered to have the best instruction quality among free 7B models; uses approximately 6GB RAM in 4-bit GGUF format.

Details

• Services: text generation, instruction following

Related

gguf-4-bit-quantisation local-llm-inference llama-cpp ollama