Structured inference with Llama 2 in your browser
☆52Nov 1, 2024Updated last year
Alternatives and similar repositories for ad-llama
Users that are interested in ad-llama are comparing it to the libraries listed below
Sorting:
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆50Jul 23, 2024Updated last year
- Libraries, guides, blueprints, and sample code, to enable rapidly building 0-1 applications on iOS, Android and web.☆11May 12, 2023Updated 2 years ago
- YourAICHAT☆13Aug 16, 2023Updated 2 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆16Feb 16, 2026Updated 3 weeks ago
- Plug n Play GBNF Compiler for llama.cpp☆28Nov 8, 2023Updated 2 years ago
- OmniByteFormer is a generalized Transformer model that can process any type of data by converting it into byte sequences, bypassing tradi…☆15Mar 2, 2026Updated last week
- Experimental Vega Dataflow Visualization☆21Jul 28, 2016Updated 9 years ago
- An Attention Superoptimizer☆22Jan 20, 2025Updated last year
- Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.☆19Nov 11, 2024Updated last year
- Host LLM via text-generation-inference☆16Dec 5, 2023Updated 2 years ago
- A basic Docker-based installation of TVM☆11Jun 23, 2022Updated 3 years ago
- CVPR 2020 "Domain Decluttering: Simplifying Images to Mitigate Synthetic-Real Domain Shift and Improve Depth Estimation"☆36Jun 27, 2020Updated 5 years ago
- NewsAgent is an enterprise-grade news aggregation agent designed to fetch, query, and summarize news from multiple sources at scale.☆27Oct 13, 2025Updated 4 months ago
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆20Oct 13, 2025Updated 4 months ago
- A curated list of resources related to structured generation 🔥☆23Jul 25, 2025Updated 7 months ago
- Bulk ingest data into Neo4j using sync or async Python, and expose the data via FastAPI☆19Jul 13, 2023Updated 2 years ago
- Getting Starting with NIMBUS-CORE☆10Dec 16, 2023Updated 2 years ago
- chat with gpt models on treed-graph☆20May 23, 2025Updated 9 months ago
- Typescript utilities for input validation, with emphasis on security☆19Jan 3, 2024Updated 2 years ago
- System for automated integration of deep learning backends.☆47Aug 15, 2022Updated 3 years ago
- MiniGroqqle is a minimalist web search component that allows Python developers to easily integrate web search capabilities into their app…☆21Oct 25, 2024Updated last year
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Feb 20, 2026Updated 2 weeks ago
- ☆27Dec 13, 2024Updated last year
- ☆192Mar 28, 2023Updated 2 years ago
- ☆173Updated this week
- For inferring and serving local LLMs using the MLX framework☆111Mar 24, 2024Updated last year
- quick playground to animate pippin☆15Nov 11, 2024Updated last year
- Home for OctoML PyTorch Profiler☆113Apr 24, 2023Updated 2 years ago
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Mar 24, 2023Updated 2 years ago
- entropix style sampling + GUI☆27Oct 30, 2024Updated last year
- A home for the final text of all TVM RFCs.☆109Sep 24, 2024Updated last year
- A simple Jupyter Notebook for learning MLX text-completion fine-tuning!☆124Nov 10, 2024Updated last year
- Run and train GPT-2 on Apple silicon☆34Feb 6, 2024Updated 2 years ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31May 22, 2024Updated last year
- Code and data for Teddy https://arxiv.org/abs/2001.05171.☆15Jun 21, 2022Updated 3 years ago
- A red teaming agent☆18Oct 15, 2025Updated 4 months ago
- MLX Transformers is a library that provides model implementation in MLX. It uses a similar model interface as HuggingFace Transformers an…☆74Nov 19, 2024Updated last year
- A library for syntactically rewriting Python programs, pronounced (sinner).☆66Feb 22, 2022Updated 4 years ago
- Welcome to FluidAPI, it's a framework that allows you to interact with APIs using natural language. No more JSON, headers, or complex for…☆32Oct 13, 2025Updated 4 months ago