>> mistralai/Ministral-3-8B-Instruct-2512

[QUANT :: UNSTABLELLAMA]

// REPO

EXL3 quantizations of mistralai's Ministral-3-8b-Instruct-2512-BF16.

Quantized with exllamav3 0.0.18.

// QUANTS

[BRANCH] [GiB] [K/L_DIV] [PPL]
3.00bpw x x x
4.00bpw x x x
6.00bpw x x x
bf16 x 0 x

// DOWNLOAD

Use HF-CLI to pull specific branches to your local machine:
huggingface-cli download UnstableLlama/Ministral-3-8B-Instruct-2512-exl3 --revision "3bpw" --local-dir ./
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for UnstableLlama/Ministral-3-8B-Instruct-2512-exl3