Alternatives and similar repositories for cake

Users that are interested in cake are comparing it to the libraries listed below

• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,262Updated this week
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,761Updated last week
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,550Updated 2 weeks ago
• kevmo314 / scuda
  SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
  ☆1,785Updated 5 months ago
• kyutai-labs / moshi
  Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…
  ☆9,166Updated 3 weeks ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,620Updated 3 months ago
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,956Updated 7 months ago
• apple / corenet
  CoreNet: A library for training deep neural networks
  ☆7,025Updated 2 months ago
• exo-explore / exo
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
  ☆32,790Updated last month
• moonshine-ai / moonshine
  Fast and accurate automatic speech recognition (ASR) for edge devices
  ☆3,024Updated 3 weeks ago
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,513Updated 10 months ago
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,764Updated 5 months ago
• build-with-groq / g1
  g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
  ☆4,220Updated 3 months ago
• janhq / ichigo
  Local realtime voice AI
  ☆2,386Updated 2 weeks ago
• gpustack / gpustack
  GPU cluster manager for optimized AI model deployment
  ☆4,200Updated this week
• luminal-ai / luminal
  Deep learning at the speed of light.
  ☆2,648Updated 3 weeks ago
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,056Updated 2 years ago
• togethercomputer / MoA
  Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
  ☆2,836Updated 11 months ago
• AnswerDotAI / gpu.cpp
  A lightweight library for portable low-level GPU computation using WebGPU.
  ☆3,923Updated 2 months ago
• bionic-gpt / bionic-gpt
  Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
  ☆2,275Updated this week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆946Updated 2 weeks ago
• InternLM / MindSearch
  🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
  ☆6,706Updated 5 months ago
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,153Updated last week
• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆3,103Updated 6 months ago
• huggingface / speech-to-speech
  Speech To Speech: an effort for an open-sourced and modular GPT4-o
  ☆4,247Updated 7 months ago
• guinmoon / LLMFarm
  llama and other large language models on iOS and MacOS offline using GGML library.
  ☆1,921Updated 2 months ago
• huggingface / chat-macOS
  Making the community's best AI chat models available to everyone.
  ☆1,985Updated 10 months ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆731Updated last year
• developersdigest / llm-answer-engine
  Perplexity Inspired Answer Engine
  ☆5,009Updated 5 months ago
• argmaxinc / WhisperKit
  On-device Speech Recognition for Apple Silicon
  ☆5,260Updated last week