introlix / SwiftletLinks
SwiftLet is a lightweight Python framework for running open-source Large Language Models (LLMs) locally using safetensors
☆28Updated 3 months ago
Alternatives and similar repositories for Swiftlet
Users that are interested in Swiftlet are comparing it to the libraries listed below
Sorting:
- ☆105Updated 4 months ago
- ☆62Updated 3 months ago
- Enhancing LLMs with LoRA☆173Updated 2 weeks ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆46Updated 2 months ago
- ☆19Updated last month
- ☆118Updated 4 months ago
- Load and run Llama from safetensors files in C☆11Updated last year
- An overview of GRPO & DeepSeek-R1 Training with Open Source GRPO Model Fine Tuning☆37Updated 5 months ago
- AI Based "Happiness Optimizer"☆12Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆102Updated 10 months ago
- ☆23Updated last year
- B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.☆26Updated last year
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆58Updated 11 months ago
- CaSIL is an advanced natural language processing system that implements a sophisticated four-layer semantic analysis architecture. It pro…☆66Updated last year
- ☆29Updated 6 months ago
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Updated last year
- ☆133Updated 6 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆82Updated last week
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆98Updated 4 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Updated last year
- ☆24Updated 9 months ago
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- chrome & firefox extension to chat with webpages: local llms☆127Updated 10 months ago
- ☆107Updated last week
- Easy to use, High Performant Knowledge Distillation for LLMs☆95Updated 6 months ago
- ☆101Updated 5 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated last year
- Spotlight-like client for Ollama on Windows.☆28Updated last year
- Efficient non-uniform quantization with GPTQ for GGUF☆52Updated last month