Alternatives and similar repositories for knowledge-distillation-transformers-pytorch-sagemaker

Users that are interested in knowledge-distillation-transformers-pytorch-sagemaker are comparing it to the libraries listed below

• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆88Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆105Updated 2 years ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆266Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆133Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆467Updated last year
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆165Updated 2 years ago
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆251Updated 2 years ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆298Updated 5 months ago
• naver / bergen
  Benchmarking library for RAG
  ☆248Updated last month
• AI21Labs / in-context-ralm
  ☆293Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆365Updated last year
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆405Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆224Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 5 months ago
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆215Updated last year
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆205Updated 2 years ago
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆240Updated 8 months ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆94Updated 2 years ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆226Updated 3 months ago
• glgh / awesome-llm-human-preference-datasets
  A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.
  ☆384Updated 2 years ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆477Updated last year
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆182Updated 3 years ago
• teticio / llama-squad
  Train Llama 2 & 3 on the SQuAD v2 task as an example of how to specialize a generalized (foundation) model.
  ☆53Updated last year
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆365Updated last year
• AIR-Bench / AIR-Bench
  [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆161Updated last month
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated 10 months ago
• Cohere-Labs-Community / parameter-efficient-moe
  ☆272Updated 2 years ago
• huggingface / cosmopedia
  ☆556Updated last year
• AlexTMallen / adaptive-retrieval
  ☆189Updated 5 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆277Updated last year