Alternatives and similar repositories for shortgpt

Users that are interested in shortgpt are comparing it to the libraries listed below

• KevKibe / memvectordb
  ⚡️Lightning fast in-memory VectorDB written in rust🦀
  ☆28Updated 9 months ago
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆64Updated 2 years ago
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆24Updated last year
• ElvisClaros / GOT-OCR2.0
  Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model
  ☆22Updated last year
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆23Updated last year
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated last year
• LAION-AI / Desktop-BUD-E_V1.0
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆23Updated last year
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated 2 years ago
• Mj23978 / OpenServer
  Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also inc…
  ☆17Updated 2 years ago
• mdolr / mind-overflow
  Open-source Rewind.ai clone written in Rust and Vue running 100% locally with whisper.cpp
  ☆51Updated 2 years ago
• MikeyBeez / codemapper
  Python module that creates a context map for AI code generation
  ☆27Updated last year
• minskylab / auto-rust
  auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…
  ☆45Updated last year
• the-crypt-keeper / tiny_starcoder
  Python examples using the bigcode/tiny_starcoder_py 159M model to generate code
  ☆45Updated 2 years ago
• hoof-ai / hoof
  "Just hoof it!" - A spotlight like interface to Ollama
  ☆63Updated last year
• chenwanqq / candle-llava
  implement llava using candle
  ☆15Updated last year
• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆218Updated 2 years ago
• chenhunghan / mlx-training-rs
  A CLI in Rust to generate synthetic data for MLX friendly training
  ☆25Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• neuralmagic / examples
  Notebooks using the Neural Magic libraries 📓
  ☆39Updated last year
• ngaut / jarvis
  ☆27Updated last year
• jimexist / surya-rs
  Rust implementation of Surya
  ☆63Updated 9 months ago
• ngmisl / mojo-qa
  Using langchain, deeplake and openai to create a Q&A on the Mojo lang programming manual
  ☆22Updated 2 years ago
• abetlen / ai-voice-chat
  Browser-based Voice Assistant
  ☆44Updated 2 years ago
• kyegomez / MLXTransformer
  Simple Implementation of a Transformer in the new framework MLX by Apple
  ☆19Updated last year
• Uminosachi / open-llm-webui
  This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).
  ☆43Updated 8 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• calmstate / Itinerant
  A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.
  ☆17Updated last year
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆51Updated last year
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆30Updated last year
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated last year