Alternatives and similar repositories for cake:

Users that are interested in cake are comparing it to the libraries listed below

• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆4,826Updated this week
• usefulsensors / moonshine
  Fast and accurate automatic speech recognition (ASR) for edge devices
  ☆2,492Updated this week
• Doriandarko / maestro
  A framework for Claude Opus to intelligently orchestrate subagents.
  ☆4,185Updated 6 months ago
• b4rtaz / distributed-llama
  Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…
  ☆1,622Updated last week
• microsoft / OmniParser
  A simple screen parsing tool towards pure vision based GUI agent
  ☆5,509Updated last week
• bklieger-groq / g1
  g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
  ☆4,147Updated last month
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,462Updated this week
• MadcowD / ell
  A language model programming library.
  ☆5,556Updated 3 weeks ago
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
  ☆8,050Updated 4 months ago
• ragapp / ragapp
  The easiest way to use Agentic RAG in any enterprise
  ☆3,972Updated 2 weeks ago
• kyutai-labs / moshi
  ☆7,156Updated this week
• exo-explore / exo
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
  ☆18,680Updated this week
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆7,353Updated this week
• jina-ai / reader
  Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
  ☆7,430Updated this week
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,326Updated this week
• pipecat-ai / pipecat
  Open Source framework for voice and multimodal conversational AI
  ☆4,299Updated this week
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆2,908Updated this week
• lavague-ai / LaVague
  Large Action Model framework to develop AI Web Agents
  ☆5,807Updated 2 months ago
• langchain-ai / open-canvas
  📃 A better UX for chat, writing content, and coding with LLMs.
  ☆3,443Updated 2 weeks ago
• Nutlope / llamacoder
  Open source Claude Artifacts – built with Llama 3.1 405B
  ☆5,083Updated this week
• janhq / ichigo
  Local realtime voice AI
  ☆2,162Updated this week
• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆2,746Updated 2 months ago
• kevmo314 / scuda
  SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
  ☆1,467Updated this week
• fixie-ai / ultravox
  A fast multimodal LLM for real-time voice
  ☆2,760Updated this week
• developersdigest / llm-answer-engine
  Build a Perplexity-Inspired Answer Engine Using Next.js, Groq, Llama-3, Langchain, OpenAI, Upstash, Brave & Serper
  ☆4,775Updated 3 months ago
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆4,670Updated last week
• togethercomputer / MoA
  Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
  ☆2,642Updated last week
• meta-llama / llama-stack
  Composable building blocks to build Llama Apps
  ☆6,036Updated this week
• QuivrHQ / MegaParse
  File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.
  ☆4,966Updated this week
• Doriandarko / claude-engineer
  Claude Engineer is an interactive command-line interface (CLI) that leverages the power of Anthropic's Claude-3.5-Sonnet model to assist …
  ☆10,626Updated last month