open-sci-ref 0.02
Updated open-sci-ref baselines. Re-training without dropout. Re-training on DCLM, FineWeb-Edu, Nemotron, HPLT-2, Pile. Further ref datasets included.
AI & ML interests
Researching and building foundation models with improved generalization and reasoning. LAION & friends spin-off for open-sourcing foundation models with strong generalization and reasoning , including datasets necessary for their creation, to serve as common open, reproducible grounds for further research experiments.
Recent Activity
open-sci-ref 0.02
Updated open-sci-ref baselines. Re-training without dropout. Re-training on DCLM, FineWeb-Edu, Nemotron, HPLT-2, Pile. Further ref datasets included.
openMaMMUT/openCLIP models trained on DataComp-1.4B, DFN-1.4
openMaMMUT/openCLIP models trained on DataComp-1.4B, DFN-1.4B and Re-LAION-2B. Pre-trained models on various scales, incl. intermediate checkpoints
models 122
Text Generation • 2B • Updated • 844
Text Generation • 2B • Updated • 870
Text Generation • 2B • Updated • 768
Image Feature Extraction • 2B • Updated • 4
Image Feature Extraction • 2B • Updated • 3
Image Feature Extraction • 2B • Updated • 3
Image Feature Extraction • 2B • Updated • 3
Image Feature Extraction • 2B • Updated • 3
Image Feature Extraction • 2B • Updated • 4
Text Generation • 2B • Updated • 3