ziozzang / Mac_mlx_phi-2_serverLinks
Test server code for Phi-2 model. support OpenAI API spec
☆18Updated 2 years ago
Alternatives and similar repositories for Mac_mlx_phi-2_server
Users that are interested in Mac_mlx_phi-2_server are comparing it to the libraries listed below
Sorting:
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆53Updated last year
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆129Updated last week
- Run large models from the terminal using Apple MLX.☆31Updated last year
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Updated last year
- the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly☆32Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆16Updated 7 months ago
- Median is an open-source flashcard application that leverages the power of spaced repetition and artificial intelligence to transform the…☆22Updated last year
- Shared personal notes created while working with the Apple MLX machine learning framework☆24Updated last week
- A CLI in Rust to generate synthetic data for MLX friendly training☆25Updated last year
- ☆15Updated last year
- MLX Swift implementation of Andrej Karpathy's Let's build GPT video☆62Updated last year
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆38Updated 2 weeks ago
- iauto is a low-code engine for building and deploying AI agents☆91Updated last year
- A proof of concept tool for using local LLMs to transform messy text documents into structured JSON☆25Updated last year
- Large-Language-Model to Machine Interface project.☆19Updated 2 years ago
- YouTube Transcript Cleaner is a simple web-based application that improves the readability of YouTube transcripts.☆26Updated 9 months ago
- Deploy and scale Large Language Models (LLMs) in production.☆38Updated last year
- Experimenting text-embeddings-inference server on both CPU and GPU☆18Updated 2 years ago
- torchlogic is a pytorch framework for developing Neuro-Symbolic AI systems and implements Neural Reasoning Networks.☆14Updated 3 months ago
- ☆38Updated last year
- The purpose of this repository is to discuss on Audio transformers☆13Updated 3 months ago
- A simple script to enhance text editing across your Mac, leveraging the power of MLX. Designed for seamless integration, it offers real-t…☆108Updated last year
- Experimental LLM Inference UX to aid in creative writing☆127Updated last year
- Spying on Apple’s new predictive text model☆133Updated last year
- ☆91Updated 10 months ago
- 🧠 Retrieval Augmented Generation (RAG) example☆18Updated 4 months ago
- Easiest way to build custom agents, in a no-code notion style editor, using simple macros.☆35Updated last year
- Simple Implementation of a Transformer in the new framework MLX by Apple☆19Updated last year
- A conversational UI for chatbots using the llama.cpp server☆14Updated 6 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year