An implementation of bucketMul LLM inference
☆227Jul 1, 2024Updated last year
Alternatives and similar repositories for effort
Users that are interested in effort are comparing it to the libraries listed below
Sorting:
- ☆48Jan 18, 2024Updated 2 years ago
- ☆23Updated this week
- Attend - to what matters.☆17Feb 22, 2025Updated last year
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆281Nov 3, 2023Updated 2 years ago
- A GPU Accelerated Binary Vector Store☆47Feb 17, 2025Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆22Jun 30, 2025Updated 8 months ago
- Algebraic enhancements for GEMM & AI accelerators☆288Feb 28, 2025Updated last year
- ☆24Dec 11, 2024Updated last year
- Large-Language-Model to Machine Interface project.☆19Dec 5, 2023Updated 2 years ago
- the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly☆32Oct 19, 2024Updated last year
- Experimental method to use reference video to drive motion in generations without training in ComfyUI.☆37Apr 9, 2024Updated last year
- XmodelLM☆38Nov 19, 2024Updated last year
- GRadient-INformed MoE☆263Sep 25, 2024Updated last year
- Multi-model transactional embedded database☆68Dec 10, 2024Updated last year
- An implementation of the Llama architecture, to instruct and delight☆21May 31, 2025Updated 9 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆249Jun 6, 2025Updated 9 months ago
- Bamboo-7B Large Language Model☆93Mar 28, 2024Updated last year
- ☆23Jun 18, 2024Updated last year
- [TMLR'24] This repository includes the official implementation our paper "FedConv: Enhancing Convolutional Neural Networks for Handling D…☆25Apr 30, 2024Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21May 28, 2024Updated last year
- Ask AI to test your website with a specific goal☆15Dec 22, 2023Updated 2 years ago
- Serving multiple LoRA finetuned LLM as one☆1,144May 8, 2024Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆24Nov 25, 2024Updated last year
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated 11 months ago
- An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets☆69Jun 4, 2024Updated last year
- Conversational Language model toolkit for training against human preferences.☆42Apr 9, 2024Updated last year
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆226Sep 18, 2025Updated 5 months ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11May 8, 2024Updated last year
- a sharable language☆15Jan 20, 2025Updated last year
- What Would Portland Do? Generative agent experience☆13Mar 13, 2024Updated last year
- A GitHub action to run hadolint and reports violations given a Dockerfile within a repository☆13Feb 23, 2024Updated 2 years ago
- Implementation of Hyena Hierarchy in JAX☆10Apr 30, 2023Updated 2 years ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Jan 30, 2026Updated last month
- Official codebase for our paper "Do Language Models Use Their Depth Efficiently?"☆29Jun 25, 2025Updated 8 months ago
- The clickity clackity next-gen terminal.☆22Oct 18, 2025Updated 4 months ago
- A puzzle game that uses Real-Time Ray Tracing (RTX) for gameplay and rendering. Implemented in Vulkan 1.2 using VK_KHR_ray_tracing, based…☆12Dec 22, 2021Updated 4 years ago
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Jul 11, 2023Updated 2 years ago
- ☆10Oct 31, 2023Updated 2 years ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆10Sep 14, 2025Updated 5 months ago