Alternatives and similar repositories for cake

Users that are interested in cake are comparing it to the libraries listed below

• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,996Updated this week
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,269Updated this week
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,465Updated this week
• jafioti / luminal
  Deep learning at the speed of light.
  ☆2,079Updated last week
• moonshine-ai / moonshine
  Fast and accurate automatic speech recognition (ASR) for edge devices
  ☆2,805Updated 3 months ago
• togethercomputer / MoA
  Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
  ☆2,796Updated 7 months ago
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,948Updated 3 months ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,603Updated last month
• kyutai-labs / moshi
  Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…
  ☆8,760Updated last week
• aixcoder-plugin / aiXcoder-7B
  official repository of aiXcoder-7B Code Large Language Model
  ☆2,271Updated last month
• adamcohenhillel / ADeus
  An open source AI wearable device that captures what you say and hear in the real world and then transcribes and stores it on your own se…
  ☆3,240Updated last year
• kevmo314 / scuda
  SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
  ☆1,752Updated last month
• bklieger-groq / g1
  g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
  ☆4,227Updated 6 months ago
• menloresearch / cortex.cpp
  Local AI API Platform
  ☆2,766Updated last month
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆5,969Updated 6 months ago
• rashadphz / farfalle
  🔍 AI search engine - self-host with local or cloud LLMs
  ☆3,397Updated 10 months ago
• menloresearch / ichigo
  Local realtime voice AI
  ☆2,347Updated 5 months ago
• microsoft / aici
  AICI: Prompts as (Wasm) Programs
  ☆2,044Updated 6 months ago
• AnswerDotAI / gpu.cpp
  A lightweight library for portable low-level GPU computation using WebGPU.
  ☆3,899Updated 3 weeks ago
• intel / intel-extension-for-transformers
  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…
  ☆2,170Updated 10 months ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆710Updated 8 months ago
• mediar-ai / screenpipe
  AI app store powered by 24/7 desktop history. open source | 100% local | dev friendly | 24/7 screen, mic recording
  ☆15,411Updated this week
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,054Updated last year
• Lizonghang / prima.cpp
  prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
  ☆997Updated 3 weeks ago
• McGill-NLP / webllama
  Llama-3 agents that can browse the web by following instructions and talking to you
  ☆1,409Updated 8 months ago
• iyaja / llama-fs
  A self-organizing file system with llama 3
  ☆5,356Updated this week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆788Updated 2 weeks ago
• dabochen / spreadsheet-is-all-you-need
  A nanoGPT pipeline packed in a spreadsheet
  ☆2,120Updated last year
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,301Updated last week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,871Updated this week