Alternatives and similar repositories for mergoo

Users that are interested in mergoo are comparing it to the libraries listed below

• datamllab / LongLM
  [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
  ☆664Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆245Updated last year
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆259Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆468Updated last year
• jondurbin / bagel
  A bagel, with everything.
  ☆325Updated last year
• pratyushasharma / laser
  The Truth Is In There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  ☆389Updated last year
• huggingface / cosmopedia
  ☆559Updated last year
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆366Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆678Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆337Updated 8 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆253Updated last year
• QuixiAI / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆240Updated last year
• fanqiwan / FuseAI
  FuseAI Project
  ☆585Updated 11 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆817Updated 2 weeks ago
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆141Updated 2 years ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆316Updated 2 years ago
• uukuguy / multi_loras
  Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…
  ☆157Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆180Updated last year
• microsoft / FILM
  Official repo for "Make Your LLM Fully Utilize the Context"
  ☆260Updated last year
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆742Updated last year
• yule-BUAA / MergeLM
  Codebase for Merging Language Models (ICML 2024)
  ☆862Updated last year
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆263Updated 10 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆278Updated last year
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆733Updated last year
• writer / writing-in-the-margins
  ☆120Updated last year
• epfml / landmark-attention
  Landmark Attention: Random-Access Infinite Context Length for Transformers
  ☆427Updated 2 years ago
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆211Updated last year
• nexusflowai / NexusRaven
  NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…
  ☆318Updated 2 years ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆201Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆482Updated last year