Alternatives and similar repositories for Mac_mlx_phi-2_server:

Users that are interested in Mac_mlx_phi-2_server are comparing it to the libraries listed below

• fsndzomga / baby_agi_dspy
  a version of baby agi using dspy and typed predictors
  ☆17Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆76Updated 3 months ago
• armbues / SiLLM-examples
  Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon
  ☆17Updated last week
• simonw / llm-anyscale-endpoints
  LLM plugin for models hosted by Anyscale Endpoints
  ☆33Updated 11 months ago
• cognitivecomputations / runpod-vllm
  ☆15Updated last year
• Prismadic / magnet
  the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly
  ☆30Updated 5 months ago
• jasonjmcghee / vlearn
  With a few words and a click of a button, quickly get an engaging, high quality video. (And optionally save and share it!)
  ☆17Updated last month
• brandonrobertz / llm-document-extraction
  A proof of concept tool for using local LLMs to transform messy text documents into structured JSON
  ☆23Updated 7 months ago
• Jaykef / mlx-rag-gguf
  Minimal, clean code implementation of RAG with mlx using gguf model weights
  ☆49Updated 11 months ago
• ivanfioravanti / lmstudio_hf
  A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.
  ☆32Updated last month
• cfahlgren1 / smol-copilot
  360M model running in the browser on WebGPU
  ☆21Updated 7 months ago
• TextGeneratorio / text-generator.io
  Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io
  ☆33Updated this week
• minimaxir / chatgpt-structured-data
  Demos of ChatGPT's function calling/structured data support.
  ☆23Updated last year
• dwarvesf / llm-hosting
  This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…
  ☆20Updated 3 weeks ago
• cartesia-ai / dev-showcase
  Developer showcase of projects built on Cartesia
  ☆17Updated 7 months ago
• Mihaiii / trivia
  A live multiplayer trivia game where users can bid for the subject of the next question
  ☆29Updated 4 months ago
• levrofin / toolhub
  A collection of tools that can be used for LLM function calling
  ☆33Updated last year
• uogbuji / mlx-notes
  Shared personal notes created while working with the Apple MLX machine learning framework
  ☆22Updated 9 months ago
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆12Updated last year
• noco-ai / spellbook-ui
  ☆16Updated last year
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆20Updated 8 months ago
• justrach / pathik
  🛤️ Pathik - High-Performance Web Crawler ⚡
  ☆25Updated last week
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆31Updated last year
• mzbac / flux.1.app
  ☆22Updated 5 months ago
• N8python / mlx-gpt
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆28Updated 2 months ago
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆17Updated 7 months ago
• soheil / GPT-Funcs
  Automatically pass your funcions defined in Python to ChatGPT have it call them back seemlessly.
  ☆13Updated last year
• mify-io / mify-llm-editor
  LLM code editor for backend services
  ☆14Updated 5 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆37Updated last month
• 1rgs / tokenwiz
  A clone of OpenAI's Tokenizer page for HuggingFace Models
  ☆45Updated last year