nyunAI / PruneGPT
☆53Updated 10 months ago
Alternatives and similar repositories for PruneGPT:
Users that are interested in PruneGPT are comparing it to the libraries listed below
- Easy to use, High Performant Knowledge Distillation for LLMs☆58Updated this week
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆35Updated 11 months ago
- ☆48Updated 5 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆119Updated last year
- entropix style sampling + GUI☆25Updated 5 months ago
- Data preparation code for Amber 7B LLM☆87Updated 11 months ago
- A pipeline for LLM knowledge distillation☆100Updated last week
- Data preparation code for CrystalCoder 7B LLM☆44Updated 11 months ago
- ☆33Updated 9 months ago
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆82Updated last month
- ☆20Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 4 months ago
- QuIP quantization☆52Updated last year
- Simple examples using Argilla tools to build AI☆52Updated 4 months ago
- ☆74Updated last year
- A repository for research on medium sized language models.☆76Updated 10 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆138Updated last month
- ☆66Updated 10 months ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 10 months ago
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆102Updated last year
- ☆73Updated last year
- Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…☆38Updated last month
- LLM reads a paper and produce a working prototype☆52Updated this week
- One Line To Build Zero-Data Classifiers in Minutes☆36Updated 6 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 5 months ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆150Updated last year
- ☆47Updated 2 months ago