mzbac / mlx-moeLinks
Scripts to create your own moe models using mlx
☆90Updated last year
Alternatives and similar repositories for mlx-moe
Users that are interested in mlx-moe are comparing it to the libraries listed below
Sorting:
- ☆119Updated last year
- Fast approximate inference on a single GPU with sparsity aware offloading☆39Updated 2 years ago
- Let's create synthetic textbooks together :)☆76Updated 2 years ago
- ☆38Updated last year
- Minimal, clean code implementation of RAG with mlx using gguf model weights☆53Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- Transcribe and summarize videos using whisper and llms on apple mlx framework☆77Updated 2 years ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated 2 years ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated 2 years ago
- ☆166Updated 6 months ago
- ☆68Updated last year
- inference code for mixtral-8x7b-32kseqlen☆105Updated 2 years ago
- Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.☆43Updated 7 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆146Updated 2 years ago
- A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.☆260Updated 3 months ago
- LLaVA server (llama.cpp).☆183Updated 2 years ago
- For inferring and serving local LLMs using the MLX framework☆110Updated last year
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Updated last month
- GPT-2 small trained on phi-like data☆68Updated last year
- ☆74Updated 2 years ago
- run embeddings in MLX☆97Updated last year
- huggingface chat-ui integration with mlx-lm server☆62Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆100Updated 7 months ago
- An unsupervised model merging algorithm for Transformers-based language models.☆108Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆180Updated last year
- Implementation of nougat that focuses on processing pdf locally.☆84Updated last year
- GRDN.AI app for garden optimization☆69Updated 2 months ago
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆38Updated last year