microsoft / BitNet
Official inference framework for 1-bit LLMs
☆16,959Updated this week
Alternatives and similar repositories for BitNet:
Users that are interested in BitNet are comparing it to the libraries listed below
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,514Updated 2 weeks ago
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆21,236Updated this week
- DSPy: The framework for programming—not prompting—language models☆23,640Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆45,561Updated this week
- Agno is a lightweight library for building Agents with memory, knowledge, tools and reasoning.☆25,729Updated this week
- Finetune Llama 4, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥☆37,364Updated this week
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆16,152Updated this week
- Composable building blocks to build Llama Apps☆7,714Updated this week
- Build resilient language agents as graphs.☆11,784Updated this week
- The Memory layer for AI Agents☆27,790Updated this week
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.☆19,660Updated last month
- SGLang is a fast serving framework for large language models and vision language models.☆13,544Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆43,613Updated this week
- A simple screen parsing tool towards pure vision based GUI agent☆21,766Updated 3 weeks ago
- 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN☆40,285Updated this week
- the AI-native open-source embedding database☆19,402Updated this week
- Toolkit for linearizing PDFs for LLM datasets/training☆11,889Updated this week
- AI app store powered by 24/7 desktop history. open source | 100% local | dev friendly | 24/7 screen, mic recording☆13,542Updated last week
- Make websites accessible for AI agents☆57,498Updated this week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆36,404Updated this week
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆14,232Updated last month
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆21,430Updated last week
- LLM-powered multiagent persona simulation for imagination enhancement and business insights.☆6,156Updated last month
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆17,130Updated this week
- Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚☆27,773Updated last month
- Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.☆138,395Updated this week
- Convert PDF to markdown + JSON quickly with high accuracy☆24,338Updated last week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆24,664Updated last week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆10,965Updated 2 weeks ago
- 🙌 OpenHands: Code Less, Make More☆53,290Updated this week