Alternatives and similar repositories for ci:

Users that are interested in ci are comparing it to the libraries listed below

• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆12Updated 8 months ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 4 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• hyparam / hyllama
  llama.cpp gguf file parser for javascript
  ☆34Updated 4 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 3 months ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆24Updated this week
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 3 months ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆20Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆77Updated 4 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 10 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 5 months ago
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆66Updated 2 months ago
• jiamingkong / rwkv_reward
  Training a reward model for RLHF using RWKV.
  ☆14Updated last year
• Mozilla-Ocho / formulaic-python
  The official Python library for Formulaic
  ☆16Updated 11 months ago
• rahuldshetty / starcoder.js
  Web browser version of StarCoder.cpp
  ☆44Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 5 months ago
• codestoryai / swe_bench_traces
  Contains the model patches and the eval logs from the passing swe-bench-lite run.
  ☆10Updated 9 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 4 months ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆29Updated last year
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆17Updated 7 months ago
• FishiaT / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆11Updated 3 months ago
• AlexBodner / How_Much_VRAM
  ☆99Updated 7 months ago
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆37Updated last year
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆22Updated last month