Codys12 / airllm
AirLLM 70B inference with single 4GB GPU
☆12Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for airllm
- ☆18Updated 3 weeks ago
- run ollama & gguf easily with a single command☆48Updated 6 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆35Updated 3 weeks ago
- Modified Beam Search with periodical restart☆12Updated 2 months ago
- Light WebUI for lm.rs☆22Updated last month
- Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?☆21Updated 4 months ago
- ☆21Updated 3 months ago
- A QT GUI for large language models☆24Updated 10 months ago
- ☆25Updated 2 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated 7 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆55Updated 3 months ago
- Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…☆47Updated last month
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆20Updated 9 months ago
- A stock market bot that automatically, once a day, rebalances your Robinhood portfolio by gathering information about each ticker in the …☆34Updated 3 weeks ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆12Updated 2 months ago
- Very basic framework for parameterized large language model (Q)LoRa fine-tuning using mlx, mlx_lm, and OgbujiPT. Architecture for system…☆35Updated last week
- HTTP proxy for on-demand model loading with llama.cpp (or other OpenAI compatible backends)☆41Updated this week
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Updated this week
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆53Updated 3 weeks ago
- Integrates AI tools into Microsoft® Word® (independently developed, not affiliated with Microsoft)☆36Updated last month
- A Python library to orchestrate LLMs in a neural network-inspired structure☆41Updated last month
- LLM backed Fantasy Tribe Game☆18Updated 2 weeks ago
- An open source, Gradio-based chatbot app that combines the best of retrieval augmented generation and prompt engineering into an intellig…☆43Updated 3 months ago
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆49Updated this week
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆23Updated last week
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆37Updated 2 months ago
- ☆32Updated 2 weeks ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆28Updated 2 weeks ago
- One Line To Build Zero-Data Classifiers in Minutes☆33Updated last month