Alternatives and similar repositories for llm-eval

Users that are interested in llm-eval are comparing it to the libraries listed below

• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆31Updated 7 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 6 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆62Updated last year
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆107Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆168Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆181Updated last year
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆140Updated 5 months ago
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆88Updated last year
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆13Updated last year
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆47Updated last year
• glaive-ai / function-calling-server
  ☆37Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆100Updated 2 years ago
• QuixiAI / OpenChatML
  ☆157Updated last year
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆87Updated last month
• abetlen / ggml-python
  Python bindings for ggml
  ☆142Updated 11 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆94Updated last year
• rahuldshetty / starcoder.js
  Web browser version of StarCoder.cpp
  ☆45Updated 2 years ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆87Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆35Updated last year
• lucyknada / detective-needle-llm
  ☆12Updated 10 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• teknium1 / ShareGPT-Builder
  ☆115Updated 7 months ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆49Updated 2 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year