bigcode-project / bigcode-inference-benchmarkLinks
☆19Updated 11 months ago
Alternatives and similar repositories for bigcode-inference-benchmark
Users that are interested in bigcode-inference-benchmark are comparing it to the libraries listed below
Sorting:
- LM engine is a library for pretraining/finetuning LLMs☆59Updated this week
- Techniques used to run BLOOM at inference in parallel☆37Updated 2 years ago
- ☆67Updated 2 years ago
- train with kittens!☆61Updated 8 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆77Updated last year
- ☆79Updated last year
- ☆19Updated 2 years ago
- ☆75Updated last year
- Repository for analysis and experiments in the BigCode project.☆120Updated last year
- Simple implementation of Speculative Sampling in NumPy for GPT-2.☆95Updated last year
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆85Updated last year
- ☆30Updated last year
- A library for squeakily cleaning and filtering language datasets.☆47Updated 2 years ago
- NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference☆66Updated 7 months ago
- Experiments for efforts to train a new and improved t5☆76Updated last year
- Machine Learning eXperiment Utilities☆46Updated 2 weeks ago
- A library to create and manage configuration files, especially for machine learning projects.☆78Updated 3 years ago
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆61Updated 2 years ago
- A repository for transformer critique learning and generation☆90Updated last year
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆70Updated last year
- some common Huggingface transformers in maximal update parametrization (µP)☆81Updated 3 years ago
- Teacher - student distillation using DeepSpeed☆18Updated 2 years ago
- Experiment of using Tangent to autodiff triton☆79Updated last year
- Evaluation suite for large-scale language models.☆126Updated 3 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated 2 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆27Updated 2 years ago
- Deploy your HPC Cluster on AWS in 20min. with just 1-Click.☆55Updated 3 months ago
- Train very large language models in Jax.☆204Updated last year