bjoernpl / lm-evaluation-harness-de
A framework for few-shot evaluation of autoregressive language models.
☆13Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for lm-evaluation-harness-de
- A repository containing the code for translating popular LLM benchmarks to German.☆24Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆237Updated 4 months ago
- awesome synthetic (text) datasets☆242Updated 3 weeks ago
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆196Updated 7 months ago
- ☆93Updated last month
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆180Updated 3 weeks ago
- Let's build better datasets, together!☆206Updated this week
- An Open Source Toolkit For LLM Distillation☆358Updated 2 months ago
- This is our own implementation of 'Layer Selective Rank Reduction'☆232Updated 5 months ago
- ☆106Updated 2 months ago
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆246Updated 2 weeks ago
- ☆108Updated this week
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- ☆131Updated 4 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆173Updated 4 months ago
- A bagel, with everything.☆312Updated 7 months ago
- Prune transformer layers☆64Updated 5 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆113Updated 3 weeks ago
- Just a bunch of benchmark logs for different LLMs☆115Updated 3 months ago
- ☆112Updated last month
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆97Updated 7 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆229Updated 3 weeks ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆122Updated 8 months ago
- experiments with inference on llama☆105Updated 5 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆64Updated last month
- A set of scripts and notebooks on LLM finetunning and dataset creation☆93Updated last month
- ☆66Updated this week
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆51Updated 3 weeks ago
- The official evaluation suite and dynamic data release for MixEval.☆224Updated last week
- ☆200Updated 9 months ago