A framework for few-shot evaluation of autoregressive language models.
☆16Aug 23, 2023Updated 2 years ago
Alternatives and similar repositories for lm-evaluation-harness
Users that are interested in lm-evaluation-harness are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🐜🔧 A minimalistic tool to fine-tune your LLMs☆18Aug 17, 2023Updated 2 years ago
- Using multiple LLMs for ensemble Forecasting☆16Jan 17, 2024Updated 2 years ago
- An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.☆14Mar 20, 2024Updated 2 years ago
- Simple Model Similarities Analysis☆21Feb 3, 2024Updated 2 years ago
- Layout Analysis Dataset with Segmonto (LADaS)☆24Jul 12, 2025Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Aug 27, 2023Updated 2 years ago
- ☆32Jan 1, 2024Updated 2 years ago
- Modular task agnostic training pipeline using LFM2 from Liquid AI with unsloth.☆16Sep 13, 2025Updated 6 months ago
- Understanding the correlation between different LLM benchmarks☆29Jan 11, 2024Updated 2 years ago
- ☆12Jul 5, 2023Updated 2 years ago
- A voice chatbot using chat gpt 3.5 using vanilla JavaScript☆12Sep 16, 2025Updated 6 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆37Jul 6, 2023Updated 2 years ago
- ☆17Jul 28, 2024Updated last year
- Training and Inference Notebooks for the RedPajama (OpenLlama) models☆19May 18, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- TUI for easily running parallel coding agents☆69Mar 23, 2026Updated last week
- Set of scripts to finetune LLMs☆38Mar 30, 2024Updated 2 years ago
- Genetics for Language Models☆17Jul 1, 2024Updated last year
- ☆13May 7, 2023Updated 2 years ago
- PicWish T2I, Photo Enhancer and Background Remover for Python☆25Jul 6, 2025Updated 8 months ago
- A proof of concept library for generating and running machine learning model tests☆13Sep 27, 2020Updated 5 years ago
- Unofficial implementation of AlpaGasus☆95Sep 23, 2023Updated 2 years ago
- Best practices for product search in English and Thai using Elasticsearch☆14Mar 16, 2021Updated 5 years ago
- Website for Applied-LLMs work☆29Jan 13, 2026Updated 2 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- GUIPandasAI - Integrating Generative AI capabilities into Pandas as Web Interface along with key-words based data analysis services☆19Oct 26, 2023Updated 2 years ago
- Use Actions to acquire those precious lambda GPUs☆19Sep 7, 2023Updated 2 years ago
- [CVPR 2025 🔥] ALM-Bench is a multilingual multi-modal diverse cultural benchmark for 100 languages across 19 categories. It assesses the…☆46May 26, 2025Updated 10 months ago
- An autonomous agent for software testing: concept☆19Jul 24, 2024Updated last year
- GLiNER model in a FastAPI microservice.☆47Dec 11, 2024Updated last year
- torchlogic is a pytorch framework for developing Neuro-Symbolic AI systems and implements Neural Reasoning Networks.☆17Sep 18, 2025Updated 6 months ago
- Fork of https://github.com/o19s/elasticsearch-learning-to-rank to work with OpenSearch☆21Mar 13, 2026Updated 2 weeks ago
- ☆67Mar 4, 2024Updated 2 years ago
- Starter template for python projects☆18Feb 15, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Experimenting with langchain, FAISS, OpenAI Embeddings, and GPT-3☆26Feb 10, 2023Updated 3 years ago
- Code for NeurIPS LLM Efficiency Challenge☆60Apr 9, 2024Updated last year
- This is a demonstration of how to integrate function calls with the OpenAI API (ChatGPT), NodeJS, RapidApi.com and WorldTimeAPI.org.☆21Jul 2, 2023Updated 2 years ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆32Sep 22, 2024Updated last year
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆61Apr 8, 2024Updated last year
- Generate slides using GPT models☆10Feb 24, 2023Updated 3 years ago
- ☆16Jun 5, 2023Updated 2 years ago