Alternatives and similar repositories for ci

Users that are interested in ci are comparing it to the libraries listed below

• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated last year
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆68Updated last year
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆17Updated 7 months ago
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 11 months ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆34Updated last year
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆51Updated 11 months ago
• huggingface / llm-intellij
  LLM powered development for IntelliJ
  ☆84Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated 2 years ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆170Updated 9 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆203Updated 4 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated last week
• Mozilla-Ocho / formulaic-python
  The official Python library for Formulaic
  ☆18Updated last year
• ibm-granite / granite-3.1-language-models
  Granite 3.1 Language Models
  ☆137Updated 7 months ago
• QuixiAI / OpenChatML
  ☆166Updated 6 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆58Updated 2 years ago
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆97Updated 3 months ago
• continuedev / amplified.dev
  🔊 We believe in a future where developers are amplified, not automated
  ☆117Updated 4 months ago
• mistralai / platform-docs-public
  ☆60Updated last week
• ggerganov / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆26Updated 2 years ago
• OpenRouterTeam / openrouter-examples-python
  Examples of calling OpenRouter models from Python code
  ☆88Updated 9 months ago
• ml-explore / mlx-c
  C API for MLX
  ☆172Updated last week
• ml-explore / mlx-onnx
  MLX support for the Open Neural Network Exchange (ONNX)
  ☆63Updated last year
• google / labs-prototypes
  ☆85Updated 2 months ago
• petals-infra / health.petals.dev
  🏥 Health monitor for a Petals swarm
  ☆40Updated last year
• QuixiAI / kraken
  ☆68Updated last year
• eliahuhorwitz / Model-Atlas
  ☆34Updated 9 months ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆147Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆243Updated last year
• huggingface / api-inference-community
  ☆172Updated 11 months ago