microsoft / unilmLinks
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
☆21,915Updated 2 weeks ago
Alternatives and similar repositories for unilm
Users that are interested in unilm are comparing it to the libraries listed below
Sorting:
- Fast and memory-efficient exact attention☆21,317Updated this week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆20,347Updated last week
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"☆13,106Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆32,053Updated 3 months ago
- Ongoing research training transformer models at scale☆14,758Updated this week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆9,411Updated 2 weeks ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,795Updated last year
- Foundation Architecture for (M)LLMs☆3,128Updated last year
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆41,069Updated last week
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆154,359Updated last week
- LAVIS - A One-stop Library for Language-Vision Intelligence☆11,087Updated last year
- State-of-the-Art Text Embeddings☆18,039Updated last week
- CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image☆32,095Updated last year
- Hackable and optimized Transformers building blocks, supporting a composable construction.☆10,228Updated this week
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆24,220Updated last year
- Making large AI models cheaper, faster and more accessible☆41,310Updated last week
- Train transformer language models with reinforcement learning.☆16,809Updated this week
- Mamba SSM architecture☆16,831Updated last week
- Accessible large language models via k-bit quantization for PyTorch.☆7,855Updated 2 weeks ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,255Updated last week
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,930Updated last year
- Repo for external large-scale work☆6,547Updated last year
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,382Updated last year
- Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Py…☆24,737Updated this week
- Inference code for Llama models☆59,002Updated 11 months ago
- Transformer related optimization, including BERT, GPT☆6,377Updated last year
- An open source implementation of CLIP.☆13,178Updated last month
- End-to-End Object Detection with Transformers☆15,007Updated last year
- The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoi…☆53,025Updated last year
- Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"☆6,468Updated last month