A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.
☆317Aug 20, 2024Updated last year
Alternatives and similar repositories for llama-nuts-and-bolts
Users that are interested in llama-nuts-and-bolts are comparing it to the libraries listed below
Sorting:
- A pipeline parallel training script for LLMs.☆167Apr 30, 2025Updated 10 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆17Aug 30, 2024Updated last year
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 2 years ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Jun 7, 2024Updated last year
- A multimodal, function calling powered LLM webui.☆215Sep 23, 2024Updated last year
- Dynamic localization of applications☆14Jun 2, 2025Updated 9 months ago
- reimagine the implementation of C-3PO droid voice synthesizer and multilingual translation and communication capabilities with the latest…☆12Mar 6, 2024Updated 2 years ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- A C# implementation of GPT☆20Sep 14, 2024Updated last year
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆168Aug 11, 2025Updated 7 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Oct 9, 2024Updated last year
- A pure and fast NumPy implementation of Mamba with cache support.☆18Jun 16, 2024Updated last year
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Jan 5, 2026Updated 2 months ago
- run ollama & gguf easily with a single command☆52May 15, 2024Updated last year
- Go module for fetching embeddings from embeddings providers☆56Jul 20, 2025Updated 8 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆68Aug 21, 2024Updated last year
- The most feature-complete local AI workstation. Multi-GPU inference, integrated Stable Diffusion + ADetailer, voice cloning, research-gra…☆57Feb 24, 2026Updated 3 weeks ago
- ☆134Mar 14, 2026Updated last week
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Jun 12, 2024Updated last year
- ☆97Nov 6, 2024Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Sep 10, 2024Updated last year
- These agents work based on any local model. You ask your question and simply indicate the number of agents and experts who will answer it…☆19Feb 25, 2024Updated 2 years ago
- ☆32Sep 7, 2025Updated 6 months ago
- The BaseMind.AI monorepo☆26Feb 9, 2025Updated last year
- A Python-based voice assistant integrating speech-to-text (STT), text-to-speech (TTS), and powerful AI capabilities using either a local …☆17Dec 8, 2025Updated 3 months ago
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated last year
- A highly modular and customizable Deep Learning framework.☆25May 23, 2024Updated last year
- A free and open-source GUI tool that simplifies combining multiple code files into one, with automatic labeling and support for various p…☆14Jan 3, 2025Updated last year
- Onnx transformer pipelines in Golang☆579Updated this week
- Screenshot LLM is a Python application that leverages the power of AI to analyze screenshots. Built with PyQt6 for a user-friendly interf…☆45Nov 4, 2024Updated last year
- ☆49May 27, 2024Updated last year
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,468Mar 4, 2026Updated 2 weeks ago
- This is a training method to produce a split brain model☆14Mar 7, 2025Updated last year
- Inference of Mamba, Mamba2 and Mamba3 models in pure C☆199Updated this week
- Supercharge huggingface transformers with model parallelism.☆78Jul 23, 2025Updated 7 months ago
- structured outputs for llms☆195Oct 10, 2025Updated 5 months ago
- ☆19Jul 13, 2015Updated 10 years ago
- Inference RWKV v7 in pure C.☆44Oct 10, 2025Updated 5 months ago
- Eternal is an experimental platform for machine learning models and workflows.☆69Mar 9, 2025Updated last year