microsoft / unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
β21,052Updated last month
Alternatives and similar repositories for unilm:
Users that are interested in unilm are comparing it to the libraries listed below
- Fast and memory-efficient exact attentionβ16,835Updated this week
- π€ PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.β18,082Updated this week
- π A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iβ¦β8,608Updated this week
- CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an imageβ28,419Updated 8 months ago
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"β11,699Updated 3 months ago
- An open source implementation of CLIP.β11,481Updated last week
- QLoRA: Efficient Finetuning of Quantized LLMsβ10,366Updated 10 months ago
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.β22,171Updated 8 months ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)β¦β13,504Updated last week
- Ongoing research training transformer models at scaleβ12,032Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.β37,834Updated this week
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) trainingβ21,717Updated 7 months ago
- Hackable and optimized Transformers building blocks, supporting a composable construction.β9,319Updated this week
- LAVIS - A One-stop Library for Language-Vision Intelligenceβ10,440Updated 4 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.β40,626Updated 4 months ago
- Development repository for the Triton language and compilerβ15,146Updated this week
- Train transformer language models with reinforcement learning.β13,166Updated this week
- Accessible large language models via k-bit quantization for PyTorch.β6,901Updated this week
- Latest Advances on Multimodal Large Language Modelsβ14,664Updated this week
- Making large AI models cheaper, faster and more accessibleβ40,766Updated this week
- PyTorch code and models for the DINOv2 self-supervised learning method.β10,243Updated 8 months ago
- Transformer related optimization, including BERT, GPTβ6,116Updated last year
- The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoiβ¦β49,683Updated 6 months ago
- Instruct-tune LLaMA on consumer hardwareβ18,883Updated 8 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.β38,364Updated 2 weeks ago
- This repository contains demos I made with the Transformers library by HuggingFace.β10,436Updated 3 months ago
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)β8,845Updated 2 months ago
- Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and β¦β16,101Updated 7 months ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.β31,265Updated 3 months ago
- Inference code for Llama modelsβ58,078Updated 2 months ago