Alternatives and similar repositories for Lightning-ReLoRA

Users that are interested in Lightning-ReLoRA are comparing it to the libraries listed below

• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• Zyphra / Zyda_processing
  ☆34Updated 11 months ago
• arcee-ai / DAM
  ☆49Updated 6 months ago
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated 8 months ago
• LLM360 / k2-data-prep
  ☆20Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated last year
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 6 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• kyegomez / Finetuning-Suite
  Finetune any model on HF in less than 30 seconds
  ☆58Updated last month
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• kumar-shridhar / Screws
  SCREWS: A Modular Framework for Reasoning with Revisions
  ☆27Updated last year
• catid / lllm
  Latent Large Language Models
  ☆18Updated 9 months ago
• penfever / wildchat-50m
  Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.
  ☆29Updated 2 months ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 7 months ago
• McGill-NLP / agent-reward-bench
  AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  ☆15Updated 3 weeks ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 9 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 4 months ago
• dinobby / MAgICoRE
  ☆24Updated 8 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆62Updated last year
• tanyuqian / cappy
  NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer
  ☆43Updated last year
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 10 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• du-nlp-lab / MLR-Copilot
  ☆65Updated 2 months ago
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆22Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆25Updated 4 months ago
• Tufalabs / BeyondNextTokenPrediction
  ☆19Updated 2 months ago