Alternatives and similar repositories for cactus

Users that are interested in cactus are comparing it to the libraries listed below

• The-Pocket-World / Pocket-Flow-Framework
  Enable LLMs to Program Themselves.
  ☆609Updated last month
• ml-explore / mlx-lm
  Run LLMs with MLX
  ☆912Updated this week
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆404Updated this week
• HazyResearch / minions
  Big & Small LLMs working together
  ☆920Updated this week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆737Updated last month
• allenai / OLMoE.swift
  ☆283Updated last month
• senstella / csm-mlx
  An implementation of the CSM(Conversation Speech Model) for Apple Silicon using MLX.
  ☆349Updated 3 weeks ago
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,314Updated this week
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆245Updated this week
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆307Updated 2 months ago
• dynamiq-ai / dynamiq
  Dynamiq is an orchestration framework for agentic AI and LLM applications
  ☆867Updated this week
• sofi444 / realtime-transcription-fastrtc
  Real Time Speech Transcription with FastRTC ⚡️and Local Whisper 🤗
  ☆656Updated this week
• Mobile-Artificial-Intelligence / maid
  Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
  ☆2,011Updated last week
• lmstudio-ai / mlx-engine
  Apple MLX engine for LM Studio
  ☆583Updated 2 weeks ago
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆778Updated last week
• cartesia-ai / edge
  On-device intelligence.
  ☆348Updated 2 months ago
• kyutai-labs / hibiki
  Hibiki is a model for streaming speech translation (also known as simultaneous translation). Unlike offline translation—where one waits f…
  ☆1,102Updated last month
• meta-llama / llama-prompt-ops
  An open-source tool for seamless migration from other LLMs to Llama, and for general prompt optimization.
  ☆360Updated last week
• Vaibhavs10 / hf-llm.rs
  ☆206Updated 4 months ago
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆370Updated 10 months ago
• senstella / parakeet-mlx
  An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.
  ☆238Updated last week
• letta-ai / agent-file
  Agent File (.af): An open file format for serializing stateful AI agents with persistent memory and behavior. Share, checkpoint, and vers…
  ☆473Updated 2 weeks ago
• argmaxinc / DiffusionKit
  On-device Image Generation for Apple Silicon
  ☆618Updated last month
• facebookresearch / MobileLLM
  MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.
  ☆1,301Updated last month
• JosefAlbers / whisper-turbo-mlx
  Blazing fast whisper turbo for ASR (speech-to-text) tasks
  ☆208Updated 7 months ago
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆712Updated last year
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆848Updated last week
• morphik-org / morphik-core
  Open source multi-modal RAG for building AI apps over private knowledge.
  ☆2,478Updated this week
• argmaxinc / WhisperKitAndroid
  On-device Speech Recognition for Android
  ☆92Updated last week
• superagent-ai / reag
  Reasoning Augmented Generation
  ☆847Updated 3 months ago