Alternatives and similar repositories for shortgpt

Users that are interested in shortgpt are comparing it to the libraries listed below

• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆23Updated 7 months ago
• thisishugow / create-llama-ollama
  a simple create-llama template using llama-index v0.10 and integrated with Ollama
  ☆10Updated last year
• TextGeneratorio / text-generator.io
  Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io
  ☆34Updated last week
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆61Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• pachecoio / openai_cli
  An openAI CLI built in rust
  ☆10Updated 2 years ago
• ngmisl / mojo-qa
  Using langchain, deeplake and openai to create a Q&A on the Mojo lang programming manual
  ☆22Updated last year
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆19Updated 3 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• huggingface / candle-cublaslt
  ☆13Updated last year
• lucataco / cog-whisperspeech
  Cog wrapper for collabora/WhisperSpeech
  ☆24Updated last year
• chenhunghan / mlx-training-rs
  A CLI in Rust to generate synthetic data for MLX friendly training
  ☆24Updated last year
• blankenshipz / clerk
  LLM based file organizer
  ☆26Updated 2 years ago
• michaelgiba / ggml-rs
  Work in progress rust bindings to ggml
  ☆12Updated 2 years ago
• The-Swarm-Corporation / AgentParse
  AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…
  ☆13Updated this week
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 10 months ago
• LAION-AI / Desktop-BUD-E_V1.0
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆19Updated 7 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• PlugOvr-ai / PlugOvr
  AI Assistant
  ☆20Updated last month
• justrach / pathik
  🛤️ Pathik - High-Performance Web Crawler ⚡
  ☆26Updated 2 months ago
• mediar-ai / ui-events
  Library to stream operating system events to AI
  ☆35Updated last month
• Uminosachi / open-llm-webui
  This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).
  ☆42Updated 2 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆25Updated 6 months ago
• camenduru / Open-Sora-jupyter
  ☆13Updated last year
• kyegomez / dev-swarm
  A swarm of LLM agents that will help you test, document, and productionize your code!
  ☆16Updated this week
• Haste171 / llamaindex-retrieval-api
  API to load and query documents using RAG
  ☆15Updated last year
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated last year
• ElvisClaros / GOT-OCR2.0
  Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model
  ☆22Updated 8 months ago
• JakeFurtaw / Chat-RAG
  Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…
  ☆22Updated 3 weeks ago