Alternatives and similar repositories for cake

Users that are interested in cake are comparing it to the libraries listed below

• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,310Updated 2 weeks ago
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,774Updated 3 weeks ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,623Updated 3 months ago
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,563Updated last week
• kyutai-labs / moshi
  Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…
  ☆9,227Updated last month
• kevmo314 / scuda
  SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
  ☆1,792Updated 6 months ago
• togethercomputer / MoA
  Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
  ☆2,843Updated 11 months ago
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,503Updated 5 months ago
• ridgerchu / matmulfreellm
  Implementation for MatMul-free LM.
  ☆3,043Updated last month
• AnswerDotAI / gpu.cpp
  A lightweight library for portable low-level GPU computation using WebGPU.
  ☆3,929Updated 2 months ago
• janhq / ichigo
  Local realtime voice AI
  ☆2,411Updated last month
• luminal-ai / luminal
  Deep learning at the speed of light.
  ☆2,663Updated this week
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,763Updated 5 months ago
• huggingface / candle
  Minimalist ML framework for Rust
  ☆18,941Updated this week
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,058Updated 2 years ago
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,345Updated last week
• apple / corenet
  CoreNet: A library for training deep neural networks
  ☆7,025Updated 2 months ago
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,327Updated last year
• build-with-groq / g1
  g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
  ☆4,220Updated this week
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,156Updated last week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,964Updated 3 weeks ago
• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆3,106Updated 7 months ago
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆963Updated 2 weeks ago
• moonshine-ai / moonshine
  Fast and accurate automatic speech recognition (ASR) for edge devices
  ☆3,056Updated last month
• huggingface / speech-to-speech
  Speech To Speech: an effort for an open-sourced and modular GPT4-o
  ☆4,266Updated 8 months ago
• ml-explore / mlx-examples
  Examples in the MLX framework
  ☆8,085Updated 2 weeks ago
• microsoft / aici
  AICI: Prompts as (Wasm) Programs
  ☆2,059Updated 11 months ago
• llamastack / llama-stack-apps
  Agentic components of the Llama Stack APIs
  ☆4,285Updated 4 months ago
• myshell-ai / MeloTTS
  High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.
  ☆7,114Updated last year
• aixcoder-plugin / aiXcoder-7B
  official repository of aiXcoder-7B Code Large Language Model
  ☆2,272Updated 5 months ago