ray-project / llmperf-leaderboard

Related projects: ⓘ

• ray-project / llmperf
  LLMPerf is a library for validating and benchmarking LLMs
  ☆578Updated 3 weeks ago
• apoorvumang / prompt-lookup-decoding
  ☆444Updated 3 weeks ago
• punica-ai / punica
  Serving multiple LoRA finetuned LLM as one
  ☆946Updated 4 months ago
• vllm-project / llm-compressor
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
  ☆416Updated this week
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆178Updated 2 weeks ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆657Updated 5 months ago
• huggingface / lighteval
  LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processin…
  ☆667Updated this week
• microsoft / MInference
  To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up t…
  ☆698Updated last week
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆1,408Updated this week
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆511Updated 4 months ago
• NVIDIA / NeMo-Curator
  Scalable data pre processing and curation toolkit for LLMs
  ☆461Updated this week
• sabetAI / BLoRA
  batched loras
  ☆327Updated last year
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆659Updated last week
• arthur-ai / bench
  A tool for evaluating LLMs
  ☆377Updated 4 months ago
• nexusflowai / NexusRaven
  NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…
  ☆304Updated 11 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆478Updated 3 weeks ago
• databricks / megablocks
  ☆1,167Updated last week
• hsiehjackson / RULER
  This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
  ☆558Updated last week
• prometheus-eval / prometheus-eval
  Evaluate your LLM's response with Prometheus and GPT4 💯
  ☆753Updated last week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,116Updated this week
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆845Updated last week
• huggingface / cosmopedia
  ☆419Updated 2 months ago
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,455Updated last month
• S-LoRA / S-LoRA
  S-LoRA: Serving Thousands of Concurrent LoRA Adapters
  ☆1,702Updated 7 months ago
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆388Updated 3 weeks ago
• SqueezeAILab / SqueezeLLM
  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
  ☆629Updated last month
• agent-husky / Husky-v1
  Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …
  ☆313Updated 3 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆145Updated 2 months ago
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆577Updated 10 months ago
• mistralai / mistral-common
  ☆617Updated this week