Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,297

Base only

Active filters: llama-cpp

Nguuma/security-slm-unsloth-1.5b

Text Generation • 2B • Updated May 7 • 355 • 31

BennyDaBall/Krea-2-Engineer-V1-GGUF

Text Generation • 4B • Updated 9 days ago • 4k • 24

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 9 days ago • 20.8k • 26

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 6 days ago • 25.9k • 11

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 24 days ago • 20.4k • 88

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated 26 days ago • 12k • 105

Bahushruth/Qwen3.6-35B-A3B-abliterated-v4-GGUF

Text Generation • 35B • Updated 3 days ago • 26.8k • 6

vcruz305/Ornith-1.0-35B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 35B • Updated 4 days ago • 11.8k • 10

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 555 • 251

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated 22 days ago • 3.56k • 15

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated 20 days ago • 56.5k • 68

ankk98/dspark-gemma4-12b-block7-Q4_0-GGUF

3B • Updated 7 days ago • 2.43k • 4

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated Jun 2 • 100k • 10

wepiqx/Ornith-1.0-9B-ASHQ1-GGUF

Text Generation • 9B • Updated 6 days ago • 1.77k • 7

prithivMLmods/Q3.5-9B-DS-v4-Flash-v2.0-GGUF

Image-Text-to-Text • 9B • Updated 5 days ago • 517 • 3

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 34k • 33

IntelligentEstate/Baby_Grok3-1.5b-iQ4_K_M-GGUF

2B • Updated Feb 23, 2025 • 83 • 23

ruv/ruvltra-claude-code

Text Generation • 0.5B • Updated Mar 28 • 8.52k • 187

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 28 days ago • 48.2k • 28

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 9.43k • 319

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 14.2k • 731

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 5.19k • 27

PocketAiHub/talkie-1930-13b-it-GGUF

13B • Updated May 5 • 95 • 2

semparuthiveeran/VibeThinker-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated 20 days ago • 78.1k • 3

autotrust/gpt-oss-120b-Fable-5-Distilled-GGUF

Text Generation • 117B • Updated 10 days ago • 21.2k • 15

UraionLabs/Uraion-Agent-Small

Text Generation • 2B • Updated 3 days ago • 7.15k • 2

maczzzzzz/Qwythos-9B-Claude-Mythos-5-1M-MTP-ROCmFP4-COHERENT-GGUF

9B • Updated 7 days ago • 326 • 2

4cast/Agents-A1-Q4_K_S-GGUF

Text Generation • 35B • Updated 6 days ago • 500 • 2

Srijan-Chakraborty/Mythos-nano-Q4_0-GGUF

Text Generation • 3B • Updated 4 days ago • 47 • 2

sillykiwi/Qwen2.5-Coder-7B-Instruct-Ghidra-v2-Q4_K_M-GGUF

Text Generation • 8B • Updated 6 days ago • 611 • 2