An open source implementation of CLIP.
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
🥂 Gracefully face hCaptcha challenge with MoE(ONNX) embedded solution.
Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration
The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
A concise but complete implementation of CLIP with various experimental improvements from recent papers
A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.
[CVPR 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI
Build high-performance AI models with modular building blocks
CVPR 2023 Papers: Dive into advanced research presented at the leading computer vision conference. Keep up to date with the latest developments in computer vision and deep learning. Code included. ⭐ support visual intelligence development!
[ICCV 2023] Implicit Neural Representation for Cooperative Low-light Image Enhancement
Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey
[CVPR2020] Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation
Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar
Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
[ICML 2023] Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining
[CVPR 2024] Official PyTorch Code for "PromptKD: Unsupervised Prompt Distillation for Vision-Language Models"
A detection/segmentation dataset with labels characterized by intricate and flexible expressions. "Described Object Detection: Liberating Object Detection with Flexible Expressions" (NeurIPS 2023).
Official pytorch repository for CG-DETR "Correlation-guided Query-Dependency Calibration in Video Representation Learning for Temporal Grounding"
Pytorch version of the HyperDenseNet deep neural network for multi-modal image segmentation
Add a description, image, and links to the multi-modal-learning topic page so that developers can more easily learn about it.
To associate your repository with the multi-modal-learning topic, visit your repo's landing page and select "manage topics."