cipher982 / llm-benchmarksLinks
Benchmarking LLM Inference Speeds
☆13Updated last week
Alternatives and similar repositories for llm-benchmarks
Users that are interested in llm-benchmarks are comparing it to the libraries listed below
Sorting:
- Simple (fast) transformer inference in PyTorch with torch.compile + lit-llama code☆10Updated 2 years ago
- ☆39Updated last year
- ☆16Updated last month
- ☆44Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Updated last year
- Experiments with representation engineering☆13Updated last year
- A library for squeakily cleaning and filtering language datasets.☆48Updated 2 years ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆19Updated last year
- ☆32Updated last year
- ☆36Updated last year
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆50Updated 11 months ago
- Code repository for the c-BTM paper☆108Updated 2 years ago
- ☆13Updated last year
- A tiny easily hackable implementation of a feature dashboard.☆15Updated last month
- Utilities for the HuggingFace transformers library☆71Updated 2 years ago
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- Official repo for Learning to Reason for Long-Form Story Generation☆72Updated 7 months ago
- Sparse Autoencoder Training Library☆55Updated 6 months ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆24Updated 6 months ago
- Extract full next-token probabilities via language model APIs☆247Updated last year
- A repository for transformer critique learning and generation☆89Updated last year
- ☆65Updated 2 years ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆101Updated 11 months ago
- ☆24Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated last year
- ☆76Updated last year
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆72Updated last year
- Mechanistic Interpretability for Transformer Models☆53Updated 3 years ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated 3 weeks ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆15Updated 2 years ago