startup command please
#2
by mtcl - opened
Agreed, we need more than that - we need to know which branch of llama.cpp to use, what startup command to use and then we also need to know if it is final or draft. If draft then it means that more developments could be made in future which will likely result in them having to re-make the GGUFs
their running guide just mentions regular llama.cpp but support branch has not even started...
Yes check https://unsloth.ai/docs/models/glm-5.2 - we just made a guide for it!
No need for any special llama.cpp branch