[CVPR 2025] Video Narration as Vocabulary & Video as Long Document
- Updated
- Python
#
video-language
Here are 27 public repositories matching this topic...
[ICCV 2023] UniVTG: Towards Unified Video-Language Temporal Grounding
- Updated
- Python
An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"
video localization caption alignment segmentation coin multimodality joint multimodal-sentiment-analysis pretrain pretraining msrvtt video-text-retrieval video-text video-language youcookii retrieval-task caption-task
- Updated
- Python
[CVPR2022] Official Implementation of ReferFormer
- Updated
- Python
[CVPR2023] All in One: Exploring Unified Video-Language Pre-training
- Updated
- Python
[NeurIPS 2022] Egocentric Video-Language Pretraining
- Updated
- Python
The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-language transformer, video-language transformer and self-supervised learning models. Additionally, it also collects many useful tutorials and tools in these related domains.
language multi-modal image-transformer vision-transformer video-language efficiency-transformer video-transformer mlp-mixer transformer-readling-list multi-modal-cvpr2021
- Updated
Align and Prompt: Video-and-Language Pre-training with Entity Prompts
representation-learning vision-and-language video-question-answering video-text-retrieval video-language prompt-learning
- Updated
- Python
A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
benchmark research video-summarization dataset video-captioning video-story vision-language video-question-answering video-language large-language-models video-language-pretraining video-story-generation
- Updated
- Python
Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
- Updated
- Python
[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)
nlp video vision srl captioning captioning-videos vision-and-language grounding video-language event-relations semantic-roles
- Updated
- Python
[NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos
- Updated
- JavaScript
A Survey on video and language understanding.
machine-learning deep-learning paper dataset multimodal-deep-learning awesome-papers video-language video-language-pretraining video-language-understanding
- Updated
The Pytorch implementation for "Video-Text Pre-training with Learned Regions"
- Updated
- Python
A curated list of video-text datasets in a variety of languages. These datasets can be used for video captioning (video description) or video retrieval.
dataset video-captioning video-to-text video-retrieval video-description vision-language video-text video-language
- Updated
PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
- Updated
- Python
[EMNLP 2024] A Video Chat Agent with Temporal Prior
- Updated
- Python
[NeurIPS25] Official Implementation (Pytorch) of "DeepVideo-R1"
multimodal-deep-learning video-language multimodal-large-language-models video-large-language-models grpo neurips-2025
- Updated
- Python
Official implementation for paper Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed Videos
pytorch representation-learning pytorch-implementation dense-video-captioning video-grounding video-language temporal-localization long-video-understanding
- Updated
- Python
Code for CVPR 2023 paper "SViTT: Temporal Learning of Sparse Video-Text Transformers"
- Updated
- Python
Improve this page
Add a description, image, and links to the video-language topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the video-language topic, visit your repo's landing page and select "manage topics."