Alternatives and similar repositories for cake

Users that are interested in cake are comparing it to the libraries listed below

• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,379Updated this week
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,804Updated last week
• kevmo314 / scuda
  SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
  ☆1,800Updated 3 weeks ago
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,761Updated 6 months ago
• kyutai-labs / moshi
  Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…
  ☆9,333Updated last week
• floneum / floneum
  Instant, controllable, local pre-trained AI models in Rust
  ☆2,122Updated last week
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,625Updated 4 months ago
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,723Updated last year
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,060Updated 2 years ago
• exo-explore / exo
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
  ☆40,273Updated last week
• microsoft / aici
  AICI: Prompts as (Wasm) Programs
  ☆2,063Updated last year
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆578Updated this week
• build-with-groq / g1
  g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
  ☆4,219Updated 3 weeks ago
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,591Updated 5 months ago
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆1,028Updated last year
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,417Updated this week
• janhq / ichigo
  Local realtime voice AI
  ☆2,423Updated 2 months ago
• corbt / agent.exe
  ☆3,497Updated last year
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆742Updated last year
• RahulSChand / gpu_poor
  Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
  ☆1,388Updated last year
• rustformers / llm
  [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
  ☆6,146Updated last year
• NousResearch / DisTrO
  Distributed Training Over-The-Internet
  ☆975Updated 3 months ago
• adithya-s-k / omniparse
  Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks
  ☆6,781Updated last month
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,583Updated last month
• luminal-ai / luminal
  Deep learning at the speed of light.
  ☆2,738Updated this week
• PrimeIntellect-ai / prime-diloco
  prime is a framework for efficient, globally distributed training of AI models over the internet.
  ☆850Updated 2 months ago
• trymirai / uzu
  A high-performance inference engine for AI models
  ☆1,418Updated this week
• moonshine-ai / moonshine
  Fast and accurate automatic speech recognition (ASR) for edge devices
  ☆3,096Updated 2 months ago
• lavague-ai / LaVague
  Large Action Model framework to develop AI Web Agents
  ☆6,275Updated last year
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,326Updated last year