Alternatives and similar repositories for registry-tabby:

Users that are interested in registry-tabby are comparing it to the libraries listed below

• FFengIll / embedding.cpp
  ggml implementation of BERT Embedding
  ☆25Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆38Updated last year
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆12Updated 7 months ago
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆20Updated last year
• iboB / git-lfs-download
  Download full or partial git-lfs repos without temporarily using 2x disk space
  ☆31Updated last year
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆24Updated this week
• unit-mesh / unit-eval
  UnitEval is a benchmarking and evaluation tools for AutoDev Coder.
  ☆12Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆54Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 7 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated 11 months ago
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆18Updated last month
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆22Updated 3 weeks ago
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆50Updated 3 weeks ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆53Updated 11 months ago
• ggml-org / ci
  CI for ggml and related projects
  ☆25Updated this week
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆68Updated 4 months ago
• cpldcpu / llmbenchmark
  Various LLM Benchmarks
  ☆14Updated last week
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆187Updated last year
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆42Updated last year
• nlpodyssey / rwkv
  RWKV (Receptance Weighted Key Value) is a RNN with Transformer-level performance
  ☆39Updated 2 years ago
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆46Updated last year
• chu-tianxiang / llama-cpp-torch
  llama.cpp to PyTorch Converter
  ☆33Updated 11 months ago
• Lisoveliy / StarCoderEx
  Extension for using alternative GitHub Copilot (StarCoder API) in VSCode
  ☆100Updated last year
• SystemPanic / vllm-windows
  A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
  ☆20Updated last week
• josephrocca / rwkv-v4-web
  BlinkDL's RWKV-v4 running in the browser
  ☆47Updated 2 years ago
• RichardKelley / hflm
  A simple library for working with Hugging Face models.
  ☆14Updated 3 months ago
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆91Updated 2 months ago