ziozzang / Mac_mlx_phi-2_serverLinks
Test server code for Phi-2 model. support OpenAI API spec
☆18Updated last year
Alternatives and similar repositories for Mac_mlx_phi-2_server
Users that are interested in Mac_mlx_phi-2_server are comparing it to the libraries listed below
Sorting:
- a version of baby agi using dspy and typed predictors☆17Updated last year
- Shared personal notes created while working with the Apple MLX machine learning framework☆24Updated last month
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆52Updated last year
- ☆16Updated last year
- Simple, Fast, Parallel Huggingface GGML model downloader written in python☆24Updated last year
- Run large models from the terminal using Apple MLX.☆30Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon☆17Updated last month
- ☆15Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- GraphRag vs Embeddings☆14Updated 11 months ago
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆126Updated last month
- Median is an open-source flashcard application that leverages the power of spaced repetition and artificial intelligence to transform the…☆23Updated 7 months ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆41Updated last week
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Updated last year
- torchlogic is a pytorch framework for developing Neuro-Symbolic AI systems and implements Neural Reasoning Networks.☆10Updated last month
- A novel approach for transformer model introspection that enables saving, compressing, and manipulating internal thought states for advan…☆20Updated 2 months ago
- Run embedding models using ONNX☆34Updated last year
- Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF☆32Updated last year
- A python command-line tool to download & manage MLX AI models from Hugging Face.☆17Updated 10 months ago
- Integrate an LLM copilot within your Keras model development workflow☆28Updated last year
- Implementation of nougat that focuses on processing pdf locally.☆81Updated 5 months ago
- ☆26Updated last year
- A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.☆43Updated 4 months ago
- LLM plugin for models hosted by Anyscale Endpoints☆33Updated last year
- Embedding models from Jina AI☆60Updated last year
- ☆22Updated 8 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆86Updated this week
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆29Updated last year
- MLX Swift implementation of Andrej Karpathy's Let's build GPT video☆58Updated last year