Alternatives and similar repositories for ci

Users that are interested in ci are comparing it to the libraries listed below

• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated 8 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆159Updated 5 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆57Updated last year
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆102Updated last month
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆189Updated 2 weeks ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆33Updated last year
• ibm-granite / granite-3.1-language-models
  Granite 3.1 Language Models
  ☆127Updated 3 months ago
• QuixiAI / OpenChatML
  ☆162Updated 2 months ago
• google / labs-prototypes
  ☆82Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆31Updated 9 months ago
• eliahuhorwitz / Model-Atlas
  ☆30Updated 5 months ago
• cursor / eval
  ☆133Updated 2 years ago
• glaive-ai / function-calling-server
  ☆36Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• ml-explore / mlx-c
  C API for MLX
  ☆137Updated 2 weeks ago
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆291Updated last month
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆223Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆40Updated 3 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆220Updated last year
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆88Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• exo-explore / evML
  Resources regarding evML (edge verified machine learning)
  ☆20Updated 9 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• petals-infra / health.petals.dev
  🏥 Health monitor for a Petals swarm
  ☆39Updated last year
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆57Updated 7 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆160Updated 2 years ago
• ml-explore / mlx-onnx
  MLX support for the Open Neural Network Exchange (ONNX)
  ☆59Updated last year
• symflower / eval-dev-quality
  DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.
  ☆182Updated 4 months ago
• NousResearch / finetuning-subnet
  ☆120Updated last year