OpenGPTX / lm-evaluation-harnessLinks
A framework for few-shot evaluation of autoregressive language models.
☆11Updated 2 months ago
Alternatives and similar repositories for lm-evaluation-harness
Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below
Sorting:
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation☆40Updated 8 months ago
- ☆34Updated 3 months ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- A repository for research on medium sized language models.☆76Updated last year
- Evaluation of neuro-symbolic engines☆35Updated 10 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- QLoRA with Enhanced Multi GPU Support☆37Updated last year
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆39Updated 7 months ago
- The open source community's implementation of the all-new Multi-Modal Causal Attention from "DeepSpeed-VisualChat: Multi-Round Multi-Imag…☆12Updated last year
- ☆39Updated 11 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 9 months ago
- Code for ExploreTom☆84Updated 6 months ago
- Advanced Reasoning Benchmark Dataset for LLMs☆47Updated last year
- GoldFinch and other hybrid transformer components☆45Updated 11 months ago
- ☆51Updated 7 months ago
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆41Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 4 months ago
- Google Research☆46Updated 2 years ago
- A framework for evaluating the effectiveness of chain-of-thought reasoning in language models.☆17Updated 4 months ago
- ☆22Updated last year
- ☆63Updated 9 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- Code for Fooling Contrastive Language-Image Pre-trainined Models with CLIPMasterPrints☆15Updated 8 months ago
- Download, parse, and filter data from Phil Papers. Data-ready for The-Pile.☆17Updated last year
- ☆24Updated 9 months ago
- ☆44Updated last year
- Multi-Domain Expert Learning☆67Updated last year