neuralmagic / guidellm

Related projects: ⓘ

• cognitivecomputations / spectrum
  ☆75Updated 3 weeks ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆144Updated 2 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆213Updated this week
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆129Updated last month
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆106Updated 3 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆284Updated last month
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆78Updated 9 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆217Updated 2 months ago
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆101Updated last week
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆117Updated 3 weeks ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆195Updated last month
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆192Updated 4 months ago
• Preemo-Inc / text-generation-inference
  ☆201Updated 7 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆121Updated this week
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆116Updated this week
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆101Updated last week
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆80Updated 3 weeks ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆72Updated last week
• mixedbread-ai / baguetter
  Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…
  ☆134Updated 2 weeks ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆61Updated this week
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆43Updated last month
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆93Updated 5 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆236Updated last week
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆112Updated last month
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆223Updated 4 months ago
• apple / ml-superposition-prompting
  ☆126Updated 2 months ago
• cohere-ai / cohere-terrarium
  A simple Python sandbox for helpful LLM data agents
  ☆143Updated 3 months ago
• cognitivecomputations / kraken
  ☆64Updated 3 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆117Updated 8 months ago