A Gemini 2.5 Flash Level MLLM for Vision, Speech, and Full-Duplex Multimodal Live Streaming on Your Phone
- Updated
- Python
#
multi-modal
Here are 483 public repositories matching this topic...
Build and run agents you can see, understand and trust.
- Updated
- Python
Open-source framework for conversational voice AI agents
- Updated
- Python
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
image-classification gpt multi-modal semantic-segmentation video-classification image-text-retrieval llm vision-language-model gpt-4v vit-6b vit-22b gpt-4o
- Updated
- Python
ModelScope: bring the notion of Model-as-a-Service to life.
- Updated
- Python
AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. Includes AI personas, AGI functions, world-class Beam multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.
agi multi-model gpt multi-modal ai-agents gemini-api ai-workspace ai-suite gpt-5 librechat perplexity-api openwebui anthropic-api deepseek-api xai-api nano-banana openai-responses-api sonnet-4-5
- Updated
- TypeScript
a state-of-the-art-level open visual language model | 多模态预训练模型
- Updated
- Python
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
data-science data data-visualization data-analysis data-processing multi-modal data-pipeline synthetic-data pre-training foundation-models large-language-models llm llms instruction-tuning
- Updated
- Python
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
nlp computer-vision deep-learning transformers pytorch chinese pretrained-models multi-modal clip coreml-models contrastive-loss vision-language multi-modal-learning image-text-retrieval vision-and-language-pre-training
- Updated
- Jupyter Notebook
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
- Updated
- Python
Open Source Routing Engine for OpenStreetMap
directions openstreetmap routing astar traveling-salesman dijkstra routing-engine isochrones multi-modal tiled
- Updated
- C++
Ecommerce Search and Discovery - marqo.ai
- Updated
- Python
[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
nlp deep-learning prompt pytorch information-extraction knowledge-graph named-entity-recognition chinese ner multi-modal kg relation-extraction lightner few-shot low-resource document-level attribute-extraction knowprompt deepke instructie
- Updated
- Python
OmniGen: Unified Image Generation. https://arxiv.org/pdf/2409.11340
- Updated
- Jupyter Notebook
Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型
- Updated
- Python
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
computer-vision evaluation pytorch gemini openai vqa vit gpt multi-modal clip claude openai-api gpt4 large-language-models llm chatgpt llava qwen gpt-4v
- Updated
- Python
【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
- Updated
- Python
Represent, send, store and search multimodal data
elasticsearch machine-learning deep-learning protobuf pytorch data-structures nearest-neighbor-search cross-modal multi-modal semantic-search multimodal nested-data weaviate dataclass pydantic fastapi neural-search qdrant docarray
- Updated
- Python
Project Page for "LISA: Reasoning Segmentation via Large Language Model"
- Updated
- Python
Improve this page
Add a description, image, and links to the multi-modal topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the multi-modal topic, visit your repo's landing page and select "manage topics."