Alternatives and similar repositories for llm-eval

Users that are interested in llm-eval are comparing it to the libraries listed below

• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• QuixiAI / OpenChatML
  ☆161Updated last month
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆31Updated 8 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆182Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆191Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated 2 years ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆64Updated last year
• chu-tianxiang / llama-cpp-torch
  llama.cpp to PyTorch Converter
  ☆34Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆170Updated last year
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆82Updated 8 months ago
• glaive-ai / function-calling-server
  ☆36Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated 2 years ago
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆88Updated last year
• llmonpy / needle-in-a-needlestack
  ☆116Updated 7 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆177Updated last year
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆290Updated 3 weeks ago
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆90Updated last week
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆180Updated last week
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆208Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated last year
• mzbac / mlx-llm-server
  For inferring and serving local LLMs using the MLX framework
  ☆109Updated last year
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆13Updated last year