Alternatives and similar repositories for ci

Users that are interested in ci are comparing it to the libraries listed below

• unslothai / llama.cpp
  LLM inference in C/C++
  ☆102Updated 2 weeks ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆33Updated last year
• ibm-granite / granite-3.1-language-models
  Granite 3.1 Language Models
  ☆131Updated 4 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆197Updated 2 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆225Updated last year
• OpenRouterTeam / character
  Utility library to work with character cards and roleplay AI in general
  ☆44Updated 2 years ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• QuixiAI / OpenChatML
  ☆163Updated 3 months ago
• HyperbolicLabs / hyperbolic-gradio
  ☆18Updated 11 months ago
• ml-explore / mlx-c
  C API for MLX
  ☆151Updated this week
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• OpenRouterTeam / openrouter-examples
  Examples of integrating the OpenRouter API
  ☆245Updated this week
• QuixiAI / kraken
  ☆67Updated last year
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆377Updated last year
• ml-explore / mlx-onnx
  MLX support for the Open Neural Network Exchange (ONNX)
  ☆62Updated last year
• continuedev / amplified.dev
  🔊 We believe in a future where developers are amplified, not automated
  ☆114Updated last month
• ibm-granite / watsonx-code-assistant-individual
  For individual users, watsonx Code Assistant can access a local IBM Granite model
  ☆37Updated 4 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated 10 months ago
• futo-org / whisper-acft
  ☆166Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆40Updated 2 weeks ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆32Updated 10 months ago
• teknium1 / ShareGPT-Builder
  ☆116Updated 11 months ago
• exo-explore / evML
  Resources regarding evML (edge verified machine learning)
  ☆19Updated 10 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆58Updated 2 years ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆162Updated 6 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 4 months ago
• AlexBodner / How_Much_VRAM
  ☆102Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆232Updated last year
• Blaizzy / mlx-embeddings
  MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.
  ☆227Updated 3 weeks ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated last year