Alternatives and similar repositories for cake

Users that are interested in cake are comparing it to the libraries listed below

• EricLBuehler / mistral.rs
  Fast, flexible LLM inference
  ☆6,449Updated last week
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,588Updated this week
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,762Updated 7 months ago
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,815Updated 2 weeks ago
• kevmo314 / scuda
  SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
  ☆1,803Updated last month
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,964Updated last month
• luminal-ai / luminal
  Deep learning at the speed of light.
  ☆2,766Updated this week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆987Updated last month
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,325Updated last year
• moonshine-ai / moonshine
  Fast and accurate automatic speech recognition (ASR) for edge devices
  ☆3,128Updated 2 months ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,624Updated 4 months ago
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆2,108Updated this week
• AnswerDotAI / gpu.cpp
  A lightweight library for portable low-level GPU computation using WebGPU.
  ☆3,941Updated 3 months ago
• build-with-groq / g1
  g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
  ☆4,213Updated last month
• aixcoder-plugin / aiXcoder-7B
  official repository of aiXcoder-7B Code Large Language Model
  ☆2,273Updated 6 months ago
• McGill-NLP / webllama
  Llama-3 agents that can browse the web by following instructions and talking to you
  ☆1,406Updated last year
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,059Updated 2 years ago
• kyutai-labs / moshi
  Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…
  ☆9,557Updated 2 weeks ago
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,154Updated last week
• janhq / ichigo
  Local realtime voice AI
  ☆2,425Updated 2 months ago
• intentee / paddler
  Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙
  ☆1,430Updated 3 weeks ago
• NousResearch / DisTrO
  Distributed Training Over-The-Internet
  ☆975Updated 3 months ago
• bionic-gpt / bionic-gpt
  Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
  ☆2,295Updated this week
• apple / corenet
  CoreNet: A library for training deep neural networks
  ☆7,018Updated 3 months ago
• huggingface / chat-macOS
  Making the community's best AI chat models available to everyone.
  ☆1,980Updated last year
• togethercomputer / MoA
  Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models
  ☆2,852Updated last year
• microsoft / aici
  AICI: Prompts as (Wasm) Programs
  ☆2,062Updated last year
• guinmoon / LLMFarm
  llama and other large language models on iOS and MacOS offline using GGML library.
  ☆1,968Updated last week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,445Updated last week
• tairov / llama2.mojo
  Inference Llama 2 in one file of pure 🔥
  ☆2,116Updated 2 months ago