An open source implementation of CLIP.

Examples and tutorials on using SOTA computer vision models and techniques. Learn everything from old-school ResNet, through YOLO and object-detection transformers like DETR, to the latest models like Grounding DINO and SAM.

🥂 Gracefully face hCaptcha challenge with MoE(ONNX) embedded solution.

Video Foundation Models & Data for Multimodal Understanding

Diffusion Classifier leverages pretrained diffusion models to perform zero-shot classification without additional training

[NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"

Cybertron: the home planet of the Transformers in Go

official code of “OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understanding”

Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)

PyTorch code for MUST

Official PyTorch Implementation of MSDN (CVPR'22)

Unofficial (Golang) Go bindings for the Hugging Face Inference API

[TPAMI 2023] Generative Multi-Label Zero-Shot Learning

Implementation of Z-BERT-A: a zero-shot pipeline for unknown intent detection.

Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models to do ZSC. Hence, can be lightweight + supports more languages without trading-off accuracy. (Super simple, a 10th-grader could totally write this but since no 10th-grader did, I did) - Prithivi Da

Codes for the experiments in our EMNLP 2021 paper "Open Aspect Target Sentiment Classification with Natural Language Prompts"

Multi-Aspect Vision Language Pretraining - CVPR2024

Airflow Pipeline for Machine Learning

Deep Learning for Computer Vision 深度學習於電腦視覺 by Frank Wang 王鈺強

[ACL'23 Findings] This is the code repo for our ACL'23 Findings paper "ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval".