ray-project / llmperf-leaderboardLinks
☆463Updated last year
Alternatives and similar repositories for llmperf-leaderboard
Users that are interested in llmperf-leaderboard are comparing it to the libraries listed below
Sorting:
- ☆542Updated 10 months ago
- LLMPerf is a library for validating and benchmarking LLMs☆947Updated 6 months ago
- Serving multiple LoRA finetuned LLM as one☆1,066Updated last year
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆315Updated last year
- Comparison of Language Model Inference Engines☆217Updated 6 months ago
- Scale LLM Engine public repository☆803Updated 2 weeks ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆698Updated last year
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,260Updated 3 months ago
- An innovative library for efficient LLM inference via low-bit quantization☆349Updated 9 months ago
- batched loras☆343Updated last year
- ☆520Updated 7 months ago
- Tutorial for building LLM router☆211Updated 11 months ago
- This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…☆589Updated last year
- Automatically evaluate your LLMs in Google Colab☆641Updated last year
- A bagel, with everything.☆321Updated last year
- Fast & more realistic evaluation of chat language models. Includes leaderboard.☆187Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆303Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆947Updated 8 months ago
- This project showcases an LLMOps pipeline that fine-tunes a small-size LLM model to prepare for the outage of the service LLM.☆306Updated 2 months ago
- ☆267Updated 2 weeks ago
- Official repository for LongChat and LongEval☆521Updated last year
- Code and Data for Tau-Bench☆609Updated 5 months ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆304Updated 3 weeks ago
- [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization☆692Updated 10 months ago
- Domain Adapted Language Modeling Toolkit - E2E RAG☆322Updated 7 months ago
- ☆415Updated last year
- A tool for evaluating LLMs☆419Updated last year
- ☆199Updated last year
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆137Updated 11 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆260Updated 11 months ago