Alternatives and similar repositories for bigcode-inference-benchmark

Users that are interested in bigcode-inference-benchmark are comparing it to the libraries listed below

• huggingface / bloom-jax-inference
  ☆67Updated 2 years ago
• hadasah / btm
  ☆72Updated last year
• bigcode-project / bigcode-encoder
  ☆30Updated last year
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆78Updated 3 years ago
• bigcode-project / bigcode-tokenizer
  ☆15Updated last year
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆47Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆42Updated last year
• anadim / the-little-retrieval-test
  ☆34Updated last year
• allenai / bff
  ☆38Updated last year
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆118Updated last year
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 7 months ago
• sholtodouglas / scalingExperiments
  ☆59Updated 3 years ago
• google-research / jestimator
  Amos optimizer with JEstimator lib.
  ☆82Updated last year
• IBM / ensemble-instruct
  codebase release for EMNLP2023 paper publication
  ☆19Updated last week
• gonglinyuan / metro_t0
  Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)
  ☆22Updated last year
• IBM / dolomite-engine
  Dolomite Engine is a library for pretraining/finetuning LLMs
  ☆53Updated this week
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆69Updated 2 years ago
• leogao2 / lm_dataformat
  ☆78Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year
• sgugger / torchdynamo-tests
  ☆19Updated 2 years ago
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆46Updated last year
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆46Updated 11 months ago
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated last year
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆65Updated 5 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆75Updated last year