microsoft / BitNet
Official inference framework for 1-bit LLMs
☆11,271Updated last week
Related projects ⓘ
Alternatives and complementary repositories for BitNet
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,227Updated last week
- Finetune Llama 3.2, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 80% less memory☆18,263Updated this week
- Composable building blocks to build Llama Apps☆4,594Updated this week
- Blazingly fast LLM inference.☆4,472Updated this week
- tiny vision language model☆5,760Updated this week
- Get your documents ready for gen AI☆9,923Updated this week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆13,436Updated 3 weeks ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆10,734Updated last week
- OCR, layout analysis, reading order, table recognition in 90+ languages☆14,240Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆16,147Updated last month
- High-speed Large Language Model Serving on PCs with Consumer-grade GPUs☆7,965Updated 2 months ago
- Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevan…☆18,491Updated 2 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆30,423Updated this week
- ☆6,781Updated 3 weeks ago
- Letta (formerly MemGPT) is a framework for creating LLM services with memory.☆12,838Updated this week
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,383Updated this week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.☆27,384Updated this week
- A language model programming library.☆5,295Updated this week
- The Memory layer for your AI apps☆22,875Updated this week
- Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚☆15,283Updated this week
- Tensor library for machine learning☆11,233Updated this week
- Ollama Python library☆4,633Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆13,971Updated this week
- Build AI Agents with memory, knowledge, tools and reasoning. Chat with them using a beautiful Agent UI.☆15,471Updated this week
- RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.☆23,277Updated this week
- DSPy: The framework for programming—not prompting—language models☆18,885Updated this week
- structured outputs for llms☆8,225Updated this week
- Distribute and run LLMs with a single file.☆20,538Updated this week
- Python bindings for llama.cpp☆8,141Updated this week
- Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom dataset…☆15,222Updated this week