huggingface / lm-evaluation-harness
A framework for few-shot evaluation of language models.
☆17Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for lm-evaluation-harness
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆64Updated last month
- ☆93Updated last month
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆74Updated 10 months ago
- ☆73Updated 10 months ago
- Codebase accompanying the Summary of a Haystack paper.☆72Updated 2 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆40Updated 8 months ago
- ☆41Updated 3 weeks ago
- Small and Efficient Mathematical Reasoning LLMs☆71Updated 9 months ago
- ☆33Updated 6 months ago
- ☆56Updated 9 months ago
- ☆112Updated last month
- ☆43Updated 4 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Updated 8 months ago
- ☆41Updated 2 weeks ago
- ☆126Updated 7 months ago
- Benchmarking library for RAG☆123Updated this week
- ☆45Updated 2 months ago
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆115Updated 10 months ago
- ☆37Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆41Updated 9 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆180Updated 3 weeks ago
- This is the official repository for Inheritune.☆105Updated last month
- minimal LLM scripts for 24GB VRAM GPUs. training, inference, whatever☆33Updated this week
- A pipeline for LLM knowledge distillation☆78Updated 3 months ago
- ☆42Updated 4 months ago
- GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embeddings☆37Updated 8 months ago
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆40Updated 4 months ago
- Code for NeurIPS LLM Efficiency Challenge☆54Updated 7 months ago
- Reward Model framework for LLM RLHF☆58Updated last year
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆112Updated last year