bigcode-project / bigcode-inference-benchmark

Related projects: ⓘ

• huggingface / bloom-jax-inference
  ☆64Updated 2 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆77Updated 2 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆91Updated last year
• leogao2 / lm_dataformat
  ☆75Updated 9 months ago
• bigcode-project / bigcode-encoder
  ☆29Updated last year
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆113Updated 6 months ago
• hadasah / btm
  ☆69Updated 4 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆26Updated last year
• anadim / the-little-retrieval-test
  ☆31Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆76Updated 2 years ago
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated last year
• gonglinyuan / metro_t0
  Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)
  ☆22Updated 10 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆58Updated this week
• bigcode-project / bigcode-tokenizer
  ☆14Updated 10 months ago
• zphang / minimal-opt
  ☆67Updated 2 years ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆53Updated 5 months ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆42Updated 8 months ago
• conceptofmind / flash-gpt
  ☆34Updated this week
• andyehrenberg / flaxlm
  ☆27Updated this week
• latitudegames / RETRO-pytorch
  ☆28Updated this week
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆59Updated last year
• HazyResearch / nanoGPT-TK
  The simplest, fastest repository for training/finetuning medium-sized GPTs. Now, with kittens!
  ☆45Updated last month
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆80Updated 6 months ago
• EleutherAI / semantic-memorization
  ☆44Updated 2 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆40Updated 8 months ago
• prateeky2806 / ComPEFT
  ☆25Updated 9 months ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆58Updated last year
• mgmalek / efficient_cross_entropy
  ☆66Updated 3 months ago
• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated 9 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆45Updated last year