cipher982 / llm-benchmarksLinks
Benchmarking LLM Inference Speeds
☆12Updated 3 months ago
Alternatives and similar repositories for llm-benchmarks
Users that are interested in llm-benchmarks are comparing it to the libraries listed below
Sorting:
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆10Updated last year
- ☆9Updated last week
- Experiments with representation engineering☆11Updated last year
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆16Updated 7 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- Official repo for Learning to Reason for Long-Form Story Generation☆60Updated last month
- minimal pytorch implementation of bm25 (with sparse tensors)☆101Updated last year
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated 2 years ago
- ☆34Updated 11 months ago
- ☆44Updated 6 months ago
- Experiments for efforts to train a new and improved t5☆77Updated last year
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆33Updated 11 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆32Updated last month
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- A small package implementing some useful wrapping around nnsight☆13Updated last month
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- Engine for collecting, uploading, and downloading model activations☆18Updated 2 months ago
- A repository for transformer critique learning and generation☆90Updated last year
- Landing page for MIB: A Mechanistic Interpretability Benchmark☆10Updated last week
- A TinyStories LM with SAEs and transcoders☆11Updated 2 months ago
- Lightweight tools for quick and easy LLM demo's☆27Updated 8 months ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆15Updated last year
- ☆22Updated last year
- ☆38Updated last year
- Adversarial Training and SFT for Bot Safety Models☆40Updated 2 years ago
- Multi-Domain Expert Learning☆67Updated last year
- some common Huggingface transformers in maximal update parametrization (µP)☆80Updated 3 years ago
- Official Code for our paper: "Language Models Learn to Mislead Humans via RLHF""☆14Updated 7 months ago
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".☆69Updated last year