An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

Inference Llama 2 in one file of pure 🔥

Self-contained Machine Learning and Natural Language Processing library in Go

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

Code for CRATE (Coding RAte reduction TransformEr).

Implementation of the Swin Transformer in PyTorch.

Minimalist NMT for educational purposes

CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation

[BMVC 2022] You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction. SOTA for low light enhancement, 0.004 seconds try this for pre-processing.

[ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

[IGARSS'22]: A Transformer-Based Siamese Network for Change Detection

This repo contains the updated version of all the assignments/labs (done by me) of Deep Learning Specialization on Coursera by Andrew Ng. It includes building various deep learning models from scratch and implementing them for object detection, facial recognition, autonomous driving, neural machine translation, trigger word detection, etc.

SeqFormer: Sequential Transformer for Video Instance Segmentation (ECCV 2022 Oral)

IEEE TNNLS 2021, transformer, multi-graph transformer, graph, graph classification, sketch recognition, sketch classification, free-hand sketch, official code of the paper "Multi-Graph Transformer for Free-Hand Sketch Recognition"

The repository of ET-BERT, a network traffic classification model on encrypted traffic. The work has been accepted as The Web Conference (WWW) 2022 accepted paper.

PyContinual (An Easy and Extendible Framework for Continual Learning)

An Extensible Continual Learning Framework Focused on Language Models (LMs)

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.