VOOZH

URL: https://github.com/topics/cross-modal-learning

⇱ cross-modal-learning · GitHub Topics · GitHub

#

cross-modal-learning

Here are 32 public repositories matching this topic...

KimMeen / Time-LLM

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

machine-learning deep-learning time-series language-model time-series-analysis time-series-forecast time-series-forecasting multimodal-deep-learning cross-modality multimodal-time-series cross-modal-learning prompt-tuning large-language-models

Updated
Python

MohamedAfham / CrossPoint

Official implementation of "CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding" (CVPR, 2022)

deep-learning point-cloud transfer-learning unsupervised-learning 3d-point-clouds object-classification few-shot-learning self-supervised-learning cross-modal-learning

Updated
Python

whwu95 / Cap4Video

【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?

video-understanding cross-modal-learning video-text-retrieval video-language-understanding

Updated
Python

whwu95 / Text4Vis

【AAAI'2023 & IJCV】Transferring Vision-Language Models for Visual Recognition: A Classifier Perspective

transfer-learning action-recognition video-understanding video-recognition cross-modal-learning

Updated
Python

whwu95 / BIKE

【CVPR'2023】Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models

action-recognition video-understanding video-recognition cross-modal-learning video-language-understanding

Updated
Python

Toytiny / CMFlow

[CVPR 2023 Highlight 💡] Hidden Gems: 4D Radar Scene Flow Learning Using Cross-Modal Supervision

deep-learning optical-flow autonomous-driving mobile-robotics motion-segmentation scene-flow cross-modal-learning 4d-radar automotive-radar ego-motion-estimation

Updated
Python

choyingw / Cross-Modal-Perceptionist

CVPR 2022: Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?

machine-learning computer-vision deep-learning speech pytorch speech-synthesis biometrics cognitive-science 3d cvpr 3d-models 3dmm speech-to-face cross-modal-learning cvpr2022

Updated
Python

RunpeiDong / ACT

[ICLR 2023] Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?

representation-learning 3d-point-clouds self-supervised-learning cross-modal-learning

Updated
Python

WinfredGe / T2S

[IJCAI 2025] Official implementation of "T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Models"

machine-learning deep-learning time-series language-model time-series-analysis multimodal-deep-learning cross-modality multimodal-time-series cross-modal-learning time-series-generation

Updated
Python

mako443 / Text2Pos-CVPR2022

Code, dataset and models for our CVPR 2022 publication "Text2Pos"

nlp computer-vision localization deep-learning pytorch cross-modal cvpr language-processing cross-modal-retrieval cross-modal-learning cvpr2022

Updated
Python

knightyxp / DGL

[AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.

cross-modal-retrieval cross-modal-learning video-text-retrieval prompt-tuning parameter-efficient-tuning video-language-understanding

Updated
Python

GaochangWu / FMF-Benchmark

This is a cross-modal benchmark for industrial anomaly detection.

transformer industrial vit anomaly-detection multimodal anomaly-segmentation cross-modal-learning

Updated
Python

StarMoonWang / SeisMoLLM

Official Pytorch Implementation of SeisMoLLM: Advancing Seismic Monitoring via Cross-modal Transfer with Pre-trained Large Language Model

pytorch back-azimuth phase-picking stead cross-modal-learning earthquake-magnitude ai4science diting fine-tuning-llm first-motion-polarity earthquake-monitoring

Updated
Python

ospanbatyr / sample-efficient-multimodality

Code for the "Sample-efficient Integration of New Modalities into Large Language Models" paper

multimodal-learning hypernetworks cross-modal-learning foundation-models sample-efficiency data-efficiency

Updated
Python

Markin-Wang / CAMANet

[IJBHI 2024] This is the official implementation of CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation accepted to IEEE Journal of Biomedical and Health Informatics (J-BHI), 2023.

cross-modal-learning medical-report-generation radiology-report-generation

Updated
Python

frank-chris / ImageTextRetrieval

In this work, we implement different cross-modal learning schemes such as Siamese Network, Correlational Network and Deep Cross-Modal Projection Learning model and study their performance. We also propose a modified Deep Cross-Modal Projection Learning model that uses a different image feature extractor. We evaluate the model’s performance on im…

flask tensorflow pytorch cross-modal-retrieval cross-modal-learning image-text-retrieval

Updated
Jupyter Notebook

IGITUGraz / MemoryDependentComputation

Code for Limbacher, T., Özdenizci, O., & Legenstein, R. (2022). Memory-enriched computation and learning in spiking neural networks through Hebbian plasticity. arXiv preprint arXiv:2205.11276.

python reinforcement-learning recurrent-neural-networks neural-networks question-answering spiking-neural-networks one-shot-learning babi-tasks associations hebbian-learning memory-networks pythorch cross-modal-learning

Updated
Python

verlab / StraightToThePoint_CVPR_2020

Original PyTorch implementation of the code for the paper "Straight to the Point: Fast-forwarding Videos via Reinforcement Learning Using Textual Data" at the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020

agent reinforcement-learning computer-vision video-summarization video-processing cvpr video-analysis multimodal-learning hyperlapse fast-forward vision-and-language multimodal-deep-learning video-fast-forward text-and-image cross-modal-learning

Updated
Python

codiceSpaghetti / T4SA-2.0

This project creates the T4SA 2.0 dataset, i.e. a big set of data to train visual models for Sentiment Analysis in the Twitter domain using a cross-modal student-teacher approach.

nlp computer-vision dataset-creation twitter-sentiment-analysis cross-modal-learning student-teacher-learning

Updated
Jupyter Notebook

lyotvincent / CUCA

CUCA: Predicting fine-grained cell types from histology images through cross-modal learning in spatial transcriptomics

spatial-transcriptomics cross-modal-learning histology-images cell-type-identification

Updated
Python

Improve this page

Add a description, image, and links to the cross-modal-learning topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the cross-modal-learning topic, visit your repo's landing page and select "manage topics."

You can’t perform that action at this time.