adalkiran / llama-nuts-and-boltsView external linksLinks
A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.
☆317Aug 20, 2024Updated last year
Alternatives and similar repositories for llama-nuts-and-bolts
Users that are interested in llama-nuts-and-bolts are comparing it to the libraries listed below
Sorting:
- A pipeline parallel training script for LLMs.☆166Apr 30, 2025Updated 9 months ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆17Aug 30, 2024Updated last year
- A pure and fast NumPy implementation of Mamba with cache support.☆18Jun 16, 2024Updated last year
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 2 years ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Jun 7, 2024Updated last year
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Jan 5, 2026Updated last month
- Go module for fetching embeddings from embeddings providers☆55Jul 20, 2025Updated 6 months ago
- The most feature-complete local AI workstation. Multi-GPU inference, integrated Stable Diffusion + ADetailer, voice cloning, research-gra…☆55Feb 3, 2026Updated 2 weeks ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆66Aug 21, 2024Updated last year
- A multimodal, function calling powered LLM webui.☆216Sep 23, 2024Updated last year
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Oct 9, 2024Updated last year
- ☆49Mar 9, 2025Updated 11 months ago
- These agents work based on any local model. You ask your question and simply indicate the number of agents and experts who will answer it…☆19Feb 25, 2024Updated last year
- Rethinking the User Interface of AI☆30Updated this week
- Supercharge huggingface transformers with model parallelism.☆78Jul 23, 2025Updated 6 months ago
- ☆50May 27, 2024Updated last year
- ☆51May 31, 2024Updated last year
- Benchmarking Mobile Device Control Agents across Diverse Configurations (ICLR 2024 workshop GenAI4DM spotlight presentation; CoLLAs 2025)☆35Jul 21, 2025Updated 6 months ago
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Jun 12, 2024Updated last year
- Simple LLM inference server☆20Jun 13, 2024Updated last year
- A Python-based voice assistant integrating speech-to-text (STT), text-to-speech (TTS), and powerful AI capabilities using either a local …☆13Dec 8, 2025Updated 2 months ago
- ☆96Nov 6, 2024Updated last year
- Inference of Mamba and Mamba2 models in pure C☆196Jan 22, 2026Updated 3 weeks ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆59Dec 1, 2024Updated last year
- Incredibly descriptive audiovisual summaries for videos☆41Aug 2, 2024Updated last year
- Utilities for efficient fine-tuning, inference and evaluation of code generation models☆21Oct 3, 2023Updated 2 years ago
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆234Jun 7, 2025Updated 8 months ago
- A free and open-source GUI tool that simplifies combining multiple code files into one, with automatic labeling and support for various p…☆14Jan 3, 2025Updated last year
- Interactive coding assistant for data scientists and machine learning developers, empowered by large language models.☆99Oct 8, 2024Updated last year
- Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget☆169Aug 11, 2025Updated 6 months ago
- structured outputs for llms☆191Oct 10, 2025Updated 4 months ago
- ☆134Dec 11, 2025Updated 2 months ago
- A CLI for inspecting and visualizing GraphQL schemas☆28Aug 17, 2025Updated 6 months ago
- A highly modular and customizable Deep Learning framework.☆25May 23, 2024Updated last year
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆103Nov 25, 2024Updated last year
- Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.☆386Mar 13, 2024Updated last year
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆284Jun 16, 2025Updated 8 months ago
- Track and Collaborate on ML & AI Experiments.☆44Mar 10, 2025Updated 11 months ago