Alternatives and similar repositories for ci

Users that are interested in ci are comparing it to the libraries listed below

• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated 2 weeks ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆170Updated 9 months ago
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆378Updated last year
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆17Updated 7 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆68Updated last year
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 11 months ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆34Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆243Updated last year
• QuixiAI / OpenChatML
  ☆166Updated 6 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆58Updated 2 years ago
• OpenRouterTeam / character
  Utility library to work with character cards and roleplay AI in general
  ☆46Updated 2 years ago
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated last year
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• QuixiAI / kraken
  ☆68Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆32Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated last year
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆185Updated 8 months ago
• HyperbolicLabs / hyperbolic-gradio
  ☆18Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated 2 years ago
• huggingface / api-inference-community
  ☆172Updated 11 months ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• ibm-granite / granite-3.1-language-models
  Granite 3.1 Language Models
  ☆137Updated 7 months ago
• JacobLinCool / gradio-rs
  Gradio Client in Rust.
  ☆28Updated 2 months ago
• dropbox / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆56Updated 5 months ago
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆29Updated last year
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆23Updated last year
• AlexBodner / How_Much_VRAM
  ☆101Updated last year
• continuedev / amplified.dev
  🔊 We believe in a future where developers are amplified, not automated
  ☆117Updated 4 months ago
• EndoTheDev / OllaMoMa
  Easily explore, manage, and interact with your local Ollama models.
  ☆12Updated last year
• codestoryai / binaries
  Binary coming in ♨️
  ☆42Updated last year