Alternatives and similar repositories for bigcode-inference-benchmark

Users that are interested in bigcode-inference-benchmark are comparing it to the libraries listed below

• open-lm-engine / lm-engine
  LM engine is a library for pretraining/finetuning LLMs
  ☆59Updated this week
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• huggingface / bloom-jax-inference
  ☆67Updated 2 years ago
• HazyResearch / train-tk
  train with kittens!
  ☆61Updated 8 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆77Updated last year
• leogao2 / lm_dataformat
  ☆79Updated last year
• sgugger / torchdynamo-tests
  ☆19Updated 2 years ago
• hadasah / btm
  ☆75Updated last year
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆120Updated last year
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆95Updated last year
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆85Updated last year
• bigcode-project / bigcode-encoder
  ☆30Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated 2 years ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆66Updated 7 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆46Updated 2 weeks ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆78Updated 3 years ago
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated 2 years ago
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆90Updated last year
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆70Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆81Updated 3 years ago
• huggingface / distill-bloom-deepspeed
  Teacher - student distillation using DeepSpeed
  ☆18Updated 2 years ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆79Updated last year
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆126Updated 3 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 9 months ago
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated 2 years ago
• sayakpaul / count-tokens-hf-datasets
  This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…
  ☆27Updated 2 years ago
• Stability-AI / stability-hpc
  Deploy your HPC Cluster on AWS in 20min. with just 1-Click.
  ☆55Updated 3 months ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆204Updated last year