Alternatives and similar repositories for ci

Users that are interested in ci are comparing it to the libraries listed below

• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆58Updated 2 years ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆167Updated 8 months ago
• QuixiAI / kraken
  ☆68Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆32Updated last year
• OpenRouterTeam / character
  Utility library to work with character cards and roleplay AI in general
  ☆46Updated 2 years ago
• QuixiAI / OpenChatML
  ☆165Updated 5 months ago
• Mozilla-Ocho / formulaic-python
  The official Python library for Formulaic
  ☆18Updated last year
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆23Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated 11 months ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆33Updated last year
• ibm-granite / granite-3.1-language-models
  Granite 3.1 Language Models
  ☆136Updated 6 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆161Updated 2 years ago
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆41Updated 2 months ago
• google / labs-prototypes
  ☆86Updated last month
• deepgrove-ai / Bonsai
  ☆34Updated 9 months ago
• exo-explore / evML
  Resources regarding evML (edge verified machine learning)
  ☆20Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆53Updated 2 years ago
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 10 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆69Updated last month
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 6 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆202Updated 3 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆104Updated 3 weeks ago
• OpenRouterTeam / openrouter-examples-python
  Examples of calling OpenRouter models from Python code
  ☆87Updated 8 months ago
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆175Updated 2 years ago
• ml-explore / mlx-c
  C API for MLX
  ☆158Updated this week
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• huggingface / discord-bots
  ☆51Updated 2 years ago