Alternatives and similar repositories for registry-tabby

Users that are interested in registry-tabby are comparing it to the libraries listed below

• sourcegraph / jetbrains
  ☆89Updated last month
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated last year
• huggingface / llm-intellij
  LLM powered development for IntelliJ
  ☆84Updated last year
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 10 months ago
• jllllll / GPTQ-for-LLaMa-CUDA
  A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.
  ☆22Updated 2 years ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆47Updated last month
• janhq / cortex.llamacpp
  cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server a…
  ☆41Updated 5 months ago
• dmatora / LLM-inference-speed-benchmarks
  ☆20Updated last year
• rayliuca / T-Ragx
  Enhancing Translation with RAG-Powered Large Language Models
  ☆87Updated 3 weeks ago
• futo-org / whisper-acft
  ☆166Updated last year
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated 5 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• deepgrove-ai / Bonsai
  ☆34Updated 8 months ago
• latent-variable / r1_reasoning_effort
  Forces DeepSeek R1 models to engage in extended reasoning by intercepting early termination tokens.
  ☆19Updated 10 months ago
• jhancock532 / imaginary-people
  A data visualisation of a 100 responses when asking local LLMs to imagine a random person.
  ☆24Updated last year
• Stability-AI / StableCode
  Code Assistance/ Developer Productivity suite of Models
  ☆125Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆58Updated 2 years ago
• ggml-org / ci
  CI for ggml and related projects
  ☆31Updated 2 months ago
• Nondzu / LlamaTor
  LlamaTor: Decentralized AI model sharing via BitTorrent for efficient, user-friendly distribution and collaboration.
  ☆53Updated 11 months ago
• wavify-labs / wavify-sdks
  fast state-of-the-art speech models and a runtime that runs anywhere 💥
  ☆57Updated 6 months ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆149Updated 2 years ago
• theroyallab / ST-tabbyAPI-loader
  Loader extension for tabbyAPI in SillyTavern
  ☆26Updated 5 months ago
• kalomaze / koboldcpp
  My personal fork of koboldcpp where I hack in experimental samplers.
  ☆44Updated last year
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated 10 months ago
• gabrielolympie / moe-pruner
  A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size
  ☆80Updated 3 months ago
• SmerkyG / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆12Updated last week
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆59Updated last year
• countzero / windows_llama.cpp
  PowerShell automation to rebuild llama.cpp for a Windows environment.
  ☆32Updated last week
• srikanth235 / benchllama
  Benchmark your local LLMs.
  ☆51Updated last year