Alternatives and similar repositories for llm-eval

Users that are interested in llm-eval are comparing it to the libraries listed below

• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆54Updated last year
• mzbac / mlx-lora
  ☆38Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 4 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• rahuldshetty / starcoder.js
  Web browser version of StarCoder.cpp
  ☆44Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆101Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆89Updated last year
• iboB / git-lfs-download
  Download full or partial git-lfs repos without temporarily using 2x disk space
  ☆29Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 9 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• fairydreaming / lineage-bench
  Testing LLM reasoning abilities with lineage relationship quizzes.
  ☆27Updated 2 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆92Updated 10 months ago
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 5 months ago
• stockeh / mlx-optimizers
  A collection of optimizers for MLX
  ☆36Updated this week
• ggml-org / ci
  CI for ggml and related projects
  ☆29Updated this week
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆61Updated 4 months ago
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆37Updated last year
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆29Updated 11 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated 3 weeks ago
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆47Updated last year
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆45Updated 2 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆40Updated 3 months ago
• NolanoOrg / llama-int4-quant
  ☆26Updated 2 years ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆69Updated 2 weeks ago
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆46Updated 10 months ago