How to fine tune it with an A100?
#6
by linkai-dl - opened
exciting to know how to fine tune a 30B model with a single A100? I guess it is fine tuned using LoRA or something, instead of a fully fine tuned model?
exciting to know how to fine tune a 30B model with a single A100? I guess it is fine tuned using LoRA or something, instead of a fully fine tuned model?
You might want to look into the DeepSpeed library.