Alternatives and similar repositories for ci

Users that are interested in ci are comparing it to the libraries listed below

• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆161Updated 6 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆103Updated 2 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆193Updated last month
• ibm-granite / granite-3.1-language-models
  Granite 3.1 Language Models
  ☆127Updated 4 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆57Updated 2 years ago
• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated 9 months ago
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆93Updated 2 weeks ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆225Updated last year
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• QuixiAI / OpenChatML
  ☆162Updated 2 months ago
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆52Updated 8 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 4 months ago
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆40Updated 4 months ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆33Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• OpenRouterTeam / character
  Utility library to work with character cards and roleplay AI in general
  ☆43Updated 2 years ago
• cursor / eval
  ☆135Updated 2 years ago
• continuedev / amplified.dev
  🔊 We believe in a future where developers are amplified, not automated
  ☆112Updated last month
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆83Updated last year
• huggingface / api-inference-community
  ☆170Updated 8 months ago
• ml-explore / mlx-onnx
  MLX support for the Open Neural Network Exchange (ONNX)
  ☆60Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• glaive-ai / function-calling-server
  ☆36Updated last year
• mistralai / platform-docs-public
  ☆54Updated last week
• exo-explore / evML
  Resources regarding evML (edge verified machine learning)
  ☆19Updated 9 months ago
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆174Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆31Updated 9 months ago
• exo-explore / gym
  EXO Gym is an open-source Python toolkit that facilitates distributed AI research.
  ☆83Updated last month
• teknium1 / ShareGPT-Builder
  ☆116Updated 10 months ago