unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF Text Generation ⢠31B ⢠Updated about 3 hours ago ⢠105k ⢠414
unsloth/Qwen3-Coder-30B-A3B-Instruct Text Generation ⢠31B ⢠Updated about 5 hours ago ⢠5.18k ⢠21
unsloth/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 Text Generation ⢠18B ⢠Updated about 12 hours ago ⢠10 ⢠1
unsloth/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 Text Generation ⢠18B ⢠Updated about 12 hours ago ⢠10 ⢠1
view post Post 1541 You can now run Kimi K2.5 locally! š„We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.GGUF: unsloth/Kimi-K2.5-GGUFGuide: https://unsloth.ai/docs/models/kimi-k2.5 See translation š 8 8 š 3 3 š 1 1 + Reply
unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF Text Generation ⢠23B ⢠Updated 1 day ago ⢠23.6k ⢠80