Repository for opt-out requests.

Easily embed, cluster and semantically label text datasets

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Minimalistic large language model 3D-parallelism training

Magicoder: Source Code Is All You Need

A blazing fast inference solution for text embeddings models

Robust recipes to align language models with human and AI preferences

LLM powered development for VSCode

LLM powered development for Neovim

A framework for the evaluation of autoregressive code generation language models.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

Home of StarCoder: fine-tuning & inference!

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

Fine-tune SantaCoder for Code/Text Generation.

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

The official Python client for the Huggingface Hub.

Using short models to classify long texts

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.

A 🔥 cookiecutter template for building Hugging Face Spaces

Jupyter notebooks for the Natural Language Processing with Transformers book

cuML - RAPIDS Machine Learning Library

Course materials for introductory data science

Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

A logical, reasonably standardized, but flexible project structure for doing and sharing data science work.

Creates a learning-curve plot for Jupyter/Colab notebooks that is updated in real-time.

A high-performance topological machine learning toolbox in Python