Alternatives and similar repositories for bigcode-inference-benchmark:

Users that are interested in bigcode-inference-benchmark are comparing it to the libraries listed below

• huggingface / bloom-jax-inference
  ☆64Updated 2 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆78Updated 2 years ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆66Updated 9 months ago
• hadasah / btm
  ☆72Updated 8 months ago
• huggingface / transformers_bloom_parallel
  Techniques used to run BLOOM at inference in parallel
  ☆37Updated 2 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆76Updated 2 years ago
• allenai / bff
  ☆38Updated 9 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated last year
• IBM / dolomite-engine
  Dolomite Engine is a library for pretraining/finetuning LLMs
  ☆27Updated this week
• anadim / the-little-retrieval-test
  ☆34Updated last year
• bigcode-project / bigcode-encoder
  ☆29Updated last year
• EleutherAI / semantic-memorization
  ☆46Updated 2 months ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• bigcode-project / bigcode-analysis
  Repository for analysis and experiments in the BigCode project.
  ☆117Updated 9 months ago
• mgmalek / efficient_cross_entropy
  ☆83Updated 7 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆42Updated last year
• leogao2 / lm_dataformat
  ☆77Updated last year
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• AlanAnsell / peft
  ☆16Updated 6 months ago
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆45Updated last year
• bigcode-project / bigcode-tokenizer
  ☆15Updated last year
• CarperAI / decontamination
  This repository contains code for cleaning your training data of benchmark data to help combat data snooping.
  ☆25Updated last year
• amazon-science / llm-interpret
  Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…
  ☆29Updated last year
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆45Updated last year
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆42Updated last year
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆81Updated 10 months ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year