alexgusevski / anemll-serverLinks
An OpenAI API compatible FastAPI server that sits on top of the Anemll repo. Tested with Open WebUI.
☆13Updated 3 months ago
Alternatives and similar repositories for anemll-server
Users that are interested in anemll-server are comparing it to the libraries listed below
Sorting:
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆89Updated 2 weeks ago
- This project is a reverse-engineered version of Figma's tone changer. It uses Groq's Llama-3-8b for high-speed inference and to adjust th…☆89Updated 11 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆57Updated 7 months ago
- MLX-GUI MLX Inference Server☆69Updated last week
- Give your local LLM a real memory with a lightweight, fully local memory system — just like a human recalling past discussions. 100% off…☆55Updated last month
- Open source implementation for computer use, using light OCR models and LLMs. Get Android app in link below.☆26Updated 2 weeks ago
- Train Large Language Models on MLX.☆133Updated this week
- Conduct in-depth research with AI-driven insights : DeepDive is a command-line tool that leverages web searches and AI models to generate…☆42Updated 10 months ago
- For inferring and serving local LLMs using the MLX framework☆105Updated last year
- A collection of tools for your LLMs that run on Modal☆21Updated 4 months ago
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Updated last year
- Distributed Inference for mlx LLm☆93Updated 11 months ago
- GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For mor…☆128Updated last month
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆81Updated 2 months ago
- Yet Another (LLM) Web UI, made with Gemini☆12Updated 6 months ago
- MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.☆179Updated last month
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆30Updated last year
- A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.☆59Updated 4 months ago
- ☆28Updated last month
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆100Updated 7 months ago
- Python language chat with Ollama models locally, anthropic and openai☆25Updated 3 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆140Updated last month
- powerful and fast tool calling agents☆50Updated 3 months ago
- Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!☆25Updated 2 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆78Updated 9 months ago
- Find the hidden meaning of LLMs☆19Updated last week
- ☆95Updated last month
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆31Updated 3 months ago
- Easily view and modify JSON datasets for large language models☆78Updated 2 months ago
- Pivotal Token Search☆109Updated this week