VOOZH about

URL: https://willitrunai.com/browse/best-for/12gb

⇱ Best AI Models for 12GB VRAM — Local LLMs | WillItRunAI


1
Q4_K_M9.8 GB VRAM70.5 tok/sRuns great
SExcellent
2
Q4_K_M6.7 GB VRAM56.0 tok/sRuns great
SExcellent
3
Q4_K_M9.2 GB VRAM79.3 tok/sRuns great
SExcellent
4
Phi-4 Mini Reasoning 4B3.799999952316284B
Q4_K_M5.9 GB VRAM53.2 tok/sRuns great
SExcellent
5
Jina Embeddings v30.5720000267028809B
F165.2 GB VRAM8.0 tok/sRuns great
AGreat
6
BGE M30.5680000185966492B
F164.4 GB VRAM8.0 tok/sRuns great
AGreat
7
Q4_K_M8.9 GB VRAM79.3 tok/sRuns great
SExcellent
8
mxbai Embed Large0.33500000834465027B
F164.3 GB VRAM4.7 tok/sRuns great
AGreat
9
Snowflake Arctic Embed L0.33500000834465027B
F164.3 GB VRAM4.7 tok/sRuns great
AGreat
10
Nomic Embed Text v1.50.13699999451637268B
F162.9 GB VRAM2.0 tok/sRuns great
BGood
11
Q4_K_M8.9 GB VRAM79.3 tok/sRuns great
SExcellent
12
Q4_K_M6.7 GB VRAM56.0 tok/sRuns great
AGreat
13
BGE Large EN v1.50.33500000834465027B
F164.3 GB VRAM4.7 tok/sRuns great
AGreat
14
Q4_K_M9.2 GB VRAM79.3 tok/sRuns great
SExcellent
15
Q4_K_M8.9 GB VRAM79.3 tok/sRuns great
SExcellent
16
Q4_K_M7.2 GB VRAM91.5 tok/sRuns great
AGreat
17
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
SExcellent
18
Q4_K_M10.0 GB VRAM70.5 tok/sTight fit
AGreat
19
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
AGreat
20
Q4_K_M8.2 GB VRAM71.7 tok/sRuns great
AGreat
21
Q4_K_M8.3 GB VRAM60.1 tok/sRuns great
AGreat
22
Q4_K_M12.5 GB VRAM33.9 tok/sNeeds offload
AGreat
23
All MiniLM L6 v20.023000000044703484B
F162.4 GB VRAM2.0 tok/sRuns great
BGood
24
Q4_K_M7.2 GB VRAM91.5 tok/sRuns great
AGreat
25
Q4_K_M6.1 GB VRAM42.0 tok/sRuns great
AGreat
26
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
AGreat
27
Q4_K_M6.9 GB VRAM97.0 tok/sRuns great
AGreat
28
Q4_K_M8.9 GB VRAM79.3 tok/sRuns great
AGreat
29
Q4_K_M9.4 GB VRAM79.3 tok/sRuns great
AGreat
30
Q4_K_M11.9 GB VRAM52.9 tok/sNeeds offload
AGreat
31
Gemma 4 E2B5.099999904632568B
Q4_K_M5.7 GB VRAM71.4 tok/sRuns great
AGreat
32
Q4_K_M4.7 GB VRAM42.0 tok/sRuns great
AGreat
33
Q4_K_M5.0 GB VRAM28.0 tok/sRuns great
BGood
34
Q4_K_M8.2 GB VRAM71.7 tok/sRuns great
AGreat
35
Q4_K_M6.6 GB VRAM56.0 tok/sRuns great
AGreat
36
Q4_K_M8.9 GB VRAM79.3 tok/sRuns great
AGreat
37
Q4_K_M9.3 GB VRAM90.6 tok/sRuns great
AGreat
38
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
AGreat
39
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
AGreat
40
Q4_K_M6.0 GB VRAM56.0 tok/sRuns great
AGreat
41
Q4_K_M7.2 GB VRAM91.5 tok/sRuns great
AGreat
42
Qwen 3 1.7B1.7000000476837158B
Q4_K_M4.8 GB VRAM23.8 tok/sRuns great
BGood
43
Q4_K_M3.4 GB VRAM21.0 tok/sRuns great
BGood
44
Q4_K_M6.1 GB VRAM42.0 tok/sRuns great
BGood
45
Q4_K_M5.2 GB VRAM42.0 tok/sRuns great
BGood
46
Phi 3 Mini 3.8B3.799999952316284B
Q4_K_M10.3 GB VRAM53.2 tok/sTight fit
BGood
47
Q4_K_M7.2 GB VRAM91.5 tok/sRuns great
AGreat
48
Q4_K_M8.9 GB VRAM79.3 tok/sRuns great
AGreat
49
Q4_K_M6.5 GB VRAM92.6 tok/sRuns great
BGood
50
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
AGreat
51
Q4_K_M6.4 GB VRAM42.0 tok/sRuns great
BGood
52
Q4_K_M10.4 GB VRAM56.0 tok/sTight fit
BGood
53
Q4_K_M12.7 GB VRAM34.6 tok/sNeeds offload
BGood
54
Q4_K_M10.8 GB VRAM57.7 tok/sTight fit
BGood
55
Q4_K_M5.6 GB VRAM42.0 tok/sRuns great
BGood
56
Q4_K_M11.9 GB VRAM52.9 tok/sNeeds offload
BGood
57
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
BGood
58
Q4_K_M9.1 GB VRAM71.3 tok/sRuns great
BGood
59
TinyLlama 1.1B1.100000023841858B
Q4_K_M3.1 GB VRAM15.4 tok/sRuns great
CUsable
60
Q4_K_M3.4 GB VRAM21.0 tok/sRuns great
CUsable
61
Q4_K_M9.2 GB VRAM79.3 tok/sRuns great
BGood
62
Q4_K_M2.6 GB VRAM7.0 tok/sRuns great
CUsable
63
Q4_K_M3.4 GB VRAM21.0 tok/sRuns great
CUsable
64
Q4_K_M3.1 GB VRAM14.0 tok/sRuns great
CUsable
65
Q4_K_M5.9 GB VRAM42.0 tok/sRuns great
BGood
66
Qwen 3 0.6B0.6000000238418579B
Q4_K_M3.3 GB VRAM8.4 tok/sRuns great
CUsable
67
Q4_K_M4.9 GB VRAM28.0 tok/sRuns great
CUsable
68
Q4_K_M3.2 GB VRAM14.0 tok/sRuns great
CUsable
69
Q4_K_M8.9 GB VRAM91.2 tok/sRuns great
BGood
70
Q4_K_M9.1 GB VRAM71.3 tok/sRuns great
BGood
71
Q4_K_M7.2 GB VRAM91.5 tok/sRuns great
BGood
72
Qwen 3.5 0.6B0.6000000238418579B
Q4_K_M3.3 GB VRAM8.4 tok/sRuns great
CUsable
73
Q4_K_M2.6 GB VRAM7.0 tok/sRuns great
CUsable
74
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
BGood
75
Q4_K_M8.9 GB VRAM79.3 tok/sRuns great
BGood
76
Q4_K_M6.5 GB VRAM56.0 tok/sRuns great
CUsable
77
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
BGood
78
Q4_K_M8.9 GB VRAM79.3 tok/sRuns great
BGood
79
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
BGood
80
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
81
Q4_K_M3.6 GB VRAM28.0 tok/sRuns great
CUsable
82
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
83
Q6_K4.0 GB VRAM28.0 tok/sRuns great
CUsable
84
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
85
Q5_K_M4.6 GB VRAM42.0 tok/sRuns great
CUsable
86
Q4_K_M5.0 GB VRAM56.0 tok/sRuns great
CUsable
87
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
88
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
89
Q6_K3.0 GB VRAM14.0 tok/sRuns great
CUsable
90
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
BGood
91
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
92
Q4_K_M3.2 GB VRAM21.0 tok/sRuns great
CUsable
93
Q6_K2.6 GB VRAM7.0 tok/sRuns great
DPoor
94
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
95
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
96
TinyLlama 1.1B Chat v1.01.100000023841858B
Q4_K_M2.9 GB VRAM15.4 tok/sRuns great
CUsable
97
Q4_K_M3.6 GB VRAM28.0 tok/sRuns great
CUsable
98
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
99
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
100
Q4_K_M5.0 GB VRAM56.0 tok/sRuns great
CUsable
101
embeddinggemma 300M0.30000001192092896B
Q6_K2.4 GB VRAM4.2 tok/sRuns great
DPoor
102
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
103
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
104
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
105
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
106
Q4_K_M3.2 GB VRAM21.0 tok/sRuns great
CUsable
107
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
108
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
109
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
110
Q4_K_M12.3 GB VRAM30.1 tok/sNeeds offload
CUsable
111
Q4_K_M5.0 GB VRAM56.0 tok/sRuns great
CUsable
112
Q4_K_M3.2 GB VRAM21.0 tok/sRuns great
CUsable
113
Q4_K_M10.8 GB VRAM49.2 tok/sTight fit
CUsable
114
Q4_K_M2.8 GB VRAM14.0 tok/sRuns great
CUsable
115
Q4_K_M3.6 GB VRAM28.0 tok/sRuns great
CUsable
116
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
117
Q4_K_M2.8 GB VRAM14.0 tok/sRuns great
CUsable
118
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
119
Q4_K_M6.5 GB VRAM84.0 tok/sRuns great
CUsable
120
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
121
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
122
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
123
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
124
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
125
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
126
Q4_K_M6.5 GB VRAM84.0 tok/sRuns great
CUsable
127
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
128
TinyLlama 1.1B Chat v0.31.100000023841858B
Q4_K_M2.9 GB VRAM15.4 tok/sRuns great
CUsable
129
TinyLlama 1.1B Chat v0.61.100000023841858B
Q4_K_M2.9 GB VRAM15.4 tok/sRuns great
CUsable
130
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
131
Q4_K_M9.9 GB VRAM55.2 tok/sTight fit
CUsable
132
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
133
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
134
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
135
Nous Hermes 2 SOLAR 10.7B10.699999809265137B
Q4_K_M9.9 GB VRAM55.2 tok/sTight fit
CUsable
136
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
137
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
138
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
139
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
140
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
141
Q4_K_M12.3 GB VRAM30.1 tok/sNeeds offload
CUsable
142
Q4_K_M2.3 GB VRAM2.0 tok/sRuns great
DPoor
143
Q4_K_M7.2 GB VRAM97.0 tok/sRuns great
CUsable
144
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
145
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
146
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
147
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
148
Q4_K_M6.5 GB VRAM84.0 tok/sRuns great
CUsable
149
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
150
EXAONE 4.0 1.2B1.2000000476837158B
Q4_K_M3.0 GB VRAM16.8 tok/sRuns great
CUsable
151
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
152
Q4_K_M6.5 GB VRAM84.0 tok/sRuns great
CUsable
153
EXAONE 3.5 2.4B Instruct2.4000000953674316B
Q4_K_M3.8 GB VRAM33.6 tok/sRuns great
CUsable
154
EXAONE 3.5 7.8B Instruct7.800000190734863B
Q4_K_M7.8 GB VRAM75.7 tok/sRuns great
BGood
155
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
156
Q4_K_M6.7 GB VRAM84.0 tok/sRuns great
CUsable
157
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
158
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
159
Q4_K_M3.2 GB VRAM21.0 tok/sRuns great
CUsable
160
EXAONE 3.5 7.8B Instruct7.800000190734863B
Q4_K_M7.8 GB VRAM75.7 tok/sRuns great
CUsable
161
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
BGood
162
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
163
Falcon H1 Tiny 90M Instruct0.09000000357627869B
Q4_K_M2.3 GB VRAM2.0 tok/sRuns great
DPoor
164
EXAONE 3.5 7.8B Instruct i17.800000190734863B
Q4_K_M7.8 GB VRAM75.7 tok/sRuns great
CUsable
165
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
166
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
167
exaone 3.0 7.8b it7.800000190734863B
Q4_K_M7.8 GB VRAM75.7 tok/sRuns great
CUsable
168
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
CUsable
169
Q4_K_M2.8 GB VRAM14.0 tok/sRuns great
CUsable
170
Q4_K_M12.3 GB VRAM30.1 tok/sNeeds offload
CUsable
171
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
172
Q4_K_M9.9 GB VRAM55.2 tok/sTight fit
CUsable
173
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
174
Q4_K_M7.2 GB VRAM97.0 tok/sRuns great
CUsable
175
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
176
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
177
Q4_K_M12.3 GB VRAM30.1 tok/sNeeds offload
CUsable
178
stablelm 2 zephyr 1.6b1.600000023841858B
Q4_K_M3.3 GB VRAM22.4 tok/sRuns great
CUsable
179
Q4_K_M3.2 GB VRAM21.0 tok/sRuns great
CUsable
180
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
CUsable
181
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
182
logos16v2 stablelm2 1.6b i11.600000023841858B
Q4_K_M3.3 GB VRAM22.4 tok/sRuns great
CUsable
183
SOLAR 10.7B v1.010.699999809265137B
Q4_K_M9.9 GB VRAM55.2 tok/sTight fit
CUsable
184
Q4_K_M12.3 GB VRAM30.1 tok/sNeeds offload
CUsable
185
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
186
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
187
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
188
Q4_K_M2.9 GB VRAM15.4 tok/sRuns great
CUsable
189
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
190
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
191
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
192
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
193
Q4_K_M6.5 GB VRAM84.0 tok/sRuns great
CUsable
194
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
195
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
196
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
197
Q4_K_M5.7 GB VRAM70.0 tok/sRuns great
CUsable
198
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
CUsable
199
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
200
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
201
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
202
Q4_K_M7.9 GB VRAM73.8 tok/sRuns great
CUsable
203
Q4_K_M6.5 GB VRAM84.0 tok/sRuns great
CUsable
204
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
205
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
206
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
207
Q4_K_M9.4 GB VRAM59.0 tok/sRuns great
CUsable
208
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
209
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
210
Q4_K_M8.6 GB VRAM65.6 tok/sRuns great
BGood
211
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
212
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
213
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
214
Helply 10.2b chat i110.199999809265137B
Q4_K_M9.5 GB VRAM57.9 tok/sRuns great
CUsable
215
Q4_K_M4.3 GB VRAM42.0 tok/sRuns great
CUsable
216
Q4_K_M7.2 GB VRAM84.3 tok/sRuns great
CUsable
217
Q4_K_M8.3 GB VRAM90.6 tok/sRuns great
BGood
218
Q4_K_M6.9 GB VRAM92.0 tok/sRuns great
CUsable
219
Q4_K_M4.4 GB VRAM42.0 tok/sRuns great
CUsable