joaopauloschuler / less-parameters-llm
This repository contains the source code for the Saving 77% of the Parameters in Large Language Models Technical Report
☆29Updated 3 weeks ago
Alternatives and similar repositories for less-parameters-llm:
Users that are interested in less-parameters-llm are comparing it to the libraries listed below
- Problem-Oriented Segmentation and Retrieval EMNLP 2024 Findings☆30Updated 4 months ago
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆107Updated last month
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 4 months ago
- ☆66Updated 10 months ago
- Set of scripts to finetune LLMs☆37Updated last year
- Simple GRPO scripts and configurations.☆59Updated last month
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Collection of autoregressive model implementation☆83Updated last month
- ☆26Updated last year
- ☆99Updated 7 months ago
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆38Updated 5 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 4 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 6 months ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆21Updated 8 months ago
- An introduction to LLM Sampling☆77Updated 3 months ago
- Build Agentic workflows with function calling using open LLMs☆26Updated last week
- ☆13Updated this week
- ☆48Updated 4 months ago
- ☆19Updated 7 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆35Updated 11 months ago
- Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)☆32Updated last month
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated last month
- Tools for merging pretrained large language models.☆19Updated 9 months ago
- QLoRA for Masked Language Modeling☆21Updated last year
- Train, tune, and infer Bamba model☆87Updated 2 months ago
- ☆42Updated 2 months ago
- model activation visualiser☆90Updated this week
- ☆19Updated 5 months ago