pytorch / torchchatLinks
Run PyTorch LLMs locally on servers, desktop and mobile
☆3,622Updated 4 months ago
Alternatives and similar repositories for torchchat
Users that are interested in torchchat are comparing it to the libraries listed below
Sorting:
- ☆3,056Updated last month
- PyTorch native post-training library☆5,646Updated this week
- A PyTorch native platform for training generative AI models☆4,924Updated this week
- On-device AI across mobile, embedded and edge for PyTorch☆4,098Updated this week
- PyTorch native quantization and sparsity for training and inference☆2,611Updated this week
- A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.☆3,766Updated this week
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,434Updated this week
- MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.☆1,404Updated 8 months ago
- NanoGPT (124M) in 3 minutes☆4,116Updated this week
- Training LLMs with QLoRA + FSDP☆1,537Updated last year
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,749Updated 5 months ago
- Everything about the SmolLM and SmolVLM family of models☆3,539Updated last month
- Agentic components of the Llama Stack APIs☆4,288Updated 5 months ago
- Efficient Triton Kernels for LLM Training☆6,002Updated last week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,171Updated 4 months ago
- Sky-T1: Train your own O1 preview model within $450☆3,367Updated 5 months ago
- An Extensible Deep Learning Library☆2,310Updated this week
- llama3.np is a pure NumPy implementation for Llama 3 model.☆993Updated 8 months ago
- Examples in the MLX framework☆8,120Updated 3 weeks ago
- A simple, performant and scalable Jax LLM!☆2,072Updated this week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,661Updated 7 months ago
- The Open Cookbook for Top-Tier Code Large Language Model☆1,977Updated last year
- Implementation for MatMul-free LM.☆3,045Updated last month
- Curated list of datasets and tools for post-training.☆4,137Updated 2 months ago
- Official inference library for pre-processing of Mistral models☆840Updated this week
- ☆2,138Updated 3 weeks ago
- Open-source AI cookbook☆2,568Updated 2 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,812Updated this week
- Reaching LLaMA2 Performance with 0.1M Dollars☆988Updated last year
- Official repository for our work on micro-budget training of large-scale diffusion models.☆1,547Updated 11 months ago