NeuroRAG
AI Assistant for Neurobiologists
๐ Image
๐ Image
๐ Image
๐ Image
๐ Image
๐ Image
๐ Image
๐ Image
๐ Image
๐ Image
Table of Contents
Overview
NeuroRAG is a cutting-edge open-source project designed to revolutionize language processing in the fields of neurobiology, medicine, and psychology. By seamlessly integrating advanced language models and graph-based operations, NeuroRAG empowers users to effortlessly grade documents, evaluate answers, and rewrite queries for enhanced information retrieval. Ideal for researchers, educators, and AI enthusiasts seeking to unlock the full potential of language processing technologies.
Results (evaluation on biomedical datasets in QA task)
| Datasets | GPT4-o | Mistral Large | Llama3.3 70B | BioMistral | NeuroRAG |
|---|---|---|---|---|---|
| Medical Genetics | 0.9500 | 0.8600 | 0.9400 | 0.9400 | 0.9600 |
| College Biology | 0.9167 | 0.9514 | 0.9236 | 0.9306 | 0.9722 |
| College Medicine | 0.8382 | 0.82664 | 0.7977 | 0.7861 | 0.8728 |
Accuracy on Biological MMLU Datasets.
| Metrics | GPT4-o | Mistral Large | Llama3.3 70B | BioMistral | NeuroRAG |
|---|---|---|---|---|---|
| CosSim | 0.6005 | 0.6008 | 0.6015 | 0.4953 | 0.6346 |
| BLEU | 0.0233 | 0.0183 | 0.0122 | 0.0018 | 0.0166 |
| ROUGE-1 | 0.2973 | 0.2963 | 0.2570 | 0.2349 | 0.2738 |
| ROUGE-L | 0.1601 | 0.1542 | 0.1471 | 0.2082 | 0.1744 |
Perfromance metrics (Cosine Similarity, BLEU, ROUGE-1, ROUGE-L) on the MEDIQA Dataset with String Answers.
Features
Project Structure
Project Index
Getting Started
Prerequisites
Before getting started with NeuroRAG, ensure your runtime environment meets the following requirements:
- Programming Language: Python
- Package Manager: Pip
Installation
Install NeuroRAG using one of the following methods:
Build from source:
- Clone the NeuroRAG repository:
โฏ git clone https://github.com/Biomed-imaging-lab/NeuroRAG
- Navigate to the project directory:
โฏ cd NeuroRAG
- Install the project dependencies:
Using pip ๐ Image
โฏ pip install -r requirements.txt
Usage
Run NeuroRAG streamlit app using the following command:
โฏ docker build -t neurorag-app .
โฏ docker run -p 8501:8501 --add-host=host.docker.internal:host-gateway -e HTTP_PROXY="http://host.docker.internal:2080" -e HTTPS_PROXY="http://host.docker.internal:2080" -e OLLAMA_HOST="http://host.docker.internal:11434" -e NO_PROXY="localhost,127.0.0.1,host.docker.internal" neurorag-app
Contributing
- ๐ฌ Join the Discussions: Share your insights, provide feedback, or ask questions.
- ๐ Report Issues: Submit bugs found or log feature requests for the
NeuroRAGproject. - ๐ก Submit Pull Requests: Review open PRs, and submit your own PRs.
License
This project is protected under the Apache License 2.0 License. For more details, refer to the LICENSE file.
Authors
Vladimir Skvortsov1, Ivan Zolin1, 2, Vyacheslav Chukanov1, Ekaterina Pchitskaya1
- Laboratory of Biomedical Imaging and Data Analysis, Institute of Biomedical Systems and Biotechnology, Peter the Great St. Petersburg Polytechnic University
- ITMO University
Model tree for Biomed-imaging-lab/NeuroRAG
Base model
AbangCP/chatgpt4omini