Evolution process to find the best quant tensor weights to build the most optimal GGUF options for an AI model.
- Updated
#
gguf-quantization
Here are 12 public repositories matching this topic...
CLI tool for efficient and easy safetensors and gguf model conversion
- Updated
- Zig
Análise Avançada de Dados com Causalidade e Aprendizado por Reforço
reinforcement-learning bug-tracker data-preprocessing experimental-psychology causal-machine-learning shap-analysis hypergraph-neural-network llms-reasoning llm-fine-tuning explainability-metric unsloth gguf-quantization
- Updated
- Jupyter Notebook
Convert and quantize llm models
ai artificial-intelligence quantization top100 awesome-ai top10 quanta llm safetensors bestofthebest gguf bestofai awesome-ai-tools top-ai-tools gguf-models gguf-quantization best-ai-software gguf-model-support best-apps gguf-editor
- Updated
- Python
Unified Local AI Interface & LLM Runtime (Support GGUF, Ollama, OpenAI, Gemini, etc.). Insearch of building sovereign AI system ✨
ai webui hardware-acceleration rag ai-assistant llm llm-inference ollama gguf llm-webui gemini-sdk openai-compatible gguf-quantization llm-runtime lm-webui
- Updated
- Python
Auto GGUF Converter for HuggingFace Hub Models with Multiple Quantizations (GGUF Format)
machine-learning cmake ai tensorflow transformers huggingface ai-models huggingface-models bf16 safetensors llama-cpp gguf gguf-models gguf-quantization gguf-editor convert-gguf
- Updated
- Python
Convert Hugging Face models to GGUF with xet support.
- Updated
- Jupyter Notebook
Quantize LLMs automatically.
- Updated
- Python
Ready-to-run Colab notebook to run GLM-4.7-Flash Finetuned on Claude Opus 4.5 xHigh-Reasoning (GGUF) with llama.cpp, featuring GPU/CPU split loading, streaming chat, multi-chat manager, and a Gradio web UI — optimized for free T4 environments.
- Updated
- Jupyter Notebook
Deploying LoRAfrica on consumer CPU devices
- Updated
- Jupyter Notebook
Create optimized GGUF quantizations by cloning from any GGUF of the same architecture.
- Updated
- Python
Improve this page
Add a description, image, and links to the gguf-quantization topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the gguf-quantization topic, visit your repo's landing page and select "manage topics."