MedJamba

Multilingual Medical Model Based On Jamba

👨🏻‍💻Github •📃 Paper

👁 Apollo

🌈 Update

• [2024.04.25] MedJamba Model is published！🎉

Results

🤗 Apollo-0.5B • 🤗 Apollo-1.8B • 🤗 Apollo-2B • 🤗 Apollo-6B • 🤗 Apollo-7B • 🤗 Apollo-34B • 🤗 Apollo-72B

🤗 MedJamba

🤗 Apollo-0.5B-GGUF • 🤗 Apollo-2B-GGUF • 🤗 Apollo-6B-GGUF • 🤗 Apollo-7B-GGUF

👁 Apollo

Dataset & Evaluation

• Dataset 🤗 ApolloCorpus

• Evaluation 🤗 XMedBench

Results reproduction

To do

• Long Context Capability Evaluation and new Long-Med Benchmark

Acknowledgment

• HuatuoGPT-II
• proxy-tuning
• Apollo

Citation

Please use the following citation if you intend to use our dataset for training or evaluation:

@misc{wang2024apollo,
 title={Apollo: Lightweight Multilingual Medical LLMs towards Democratizing Medical AI to 6B People},
 author={Xidong Wang and Nuo Chen and Junyin Chen and Yan Hu and Yidong Wang and Xiangbo Wu and Anningzhe Gao and Xiang Wan and Haizhou Li and Benyou Wang},
 year={2024},
 eprint={2403.03640},
 archivePrefix={arXiv},
 primaryClass={cs.CL}
}