Alduin 4B
This model is a heretic version based on Gemma 3 4B and meant to be an uncensored limitless version of the original model.
I have personally been working on how models can be uncensored and I did this on a single H100 SXM (which I believe is a little bit of an overkill for this model) on RunPod and it took a few hours of my time working and getting things to work.
The name
It comes from The world eater dragon from skyrim.
Legal Responsibility
I personally made it as a personal fun projects. If you do something illegal with this, I will take ABSOLUTELY NO RESPONSIBILITY on that. Be careful with this model.
How to run (it can be executed on Google Colab even unquantized):
from transformers import pipeline
import torch
pipe = pipeline(
"image-text-to-text",
model="Muhammadreza/alduin-4b-it-base",
device="cuda",
torch_dtype=torch.bfloat16
)
messages = [
{
"role": "user",
"content": "What is the answer to life, universe and everything?"
}
]
output = pipe(text_inputs=messages, max_new_tokens=1000)
print(output[0]["generated_text"][-1]["content"])
or if you want the vision capabilities:
messages = [
{
"role": "system",
"content": "You are a helpful assistant"
},
{
"role": "user",
"content": [
{"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
{"type": "text", "text": "What animal is on the candy?"}
]
}
]
output = pipe(text=messages, max_new_tokens=1000)
print(output[0]["generated_text"][-1]["content"])
P.S : Since I have equipment for executing this model, I personally didn't provide a quantized version. If you can, please provide Ollama friendly quantizations.
Known Issues
- Image input doesn't work (Fixed)
- Downloads last month
- 493
