Preview release of the Borealis family of instruction tuned models by the National Library of Norway. • 20 items • Updated • 13
Borealis 4B Instruct GGUF (Preview)
Release: Dec 22nd, 2025.
Model summary
NbAiLab/borealis-4b-instruct-preview-gguf are quantized versions in GGUF format of a 4B-parameter instruction-tuned preview model intended for early testing and feedback. It is an experiment and should be treated as pre-release quality.
The original model is NbAiLab/borealis-4b-instruct-preview.
| Model | Bits | Format |
|---|---|---|
| NbAiLab/borealis-4b-instruct-preview | BF16 | Transformers (safetensors) |
| NbAiLab/borealis-4b-instruct-preview-gguf | 4 | GGUF (q4_K_M) |
| NbAiLab/borealis-4b-instruct-preview-gguf | 8 | GGUF (q8_0) |
| NbAiLab/borealis-4b-instruct-preview-gguf | BF16 | GGUF (bf16) |
| NbAiLab/borealis-4b-instruct-preview-mlx | 32 | MLX |
| NbAiLab/borealis-4b-instruct-preview-mlx-8bits | 8 | MLX (quantized) |
- Downloads last month
- 152
GGUF
Model size
4B params
Architecture
gemma3
Hardware compatibility
Log In to add your hardware
4-bit
8-bit
16-bit
Model tree for NbAiLab/borealis-4b-instruct-preview-gguf
Base model
google/gemma-3-4b-pt Finetuned
google/gemma-3-4b-it Finetuned
NbAiLab/borealis-4b-instruct-preview