Alternatives and similar repositories for knowledge-distillation-transformers-pytorch-sagemaker

Users that are interested in knowledge-distillation-transformers-pytorch-sagemaker are comparing it to the libraries listed below

• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆298Updated 7 months ago
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆88Updated last year
• AIR-Bench / AIR-Bench
  [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆166Updated 3 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆469Updated last year
• naver / bergen
  Benchmarking library for RAG
  ☆255Updated last week
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆269Updated last year
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆206Updated 3 weeks ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆106Updated 2 years ago
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆96Updated 2 years ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆279Updated last year
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆145Updated last year
• AI21Labs / in-context-ralm
  ☆294Updated 2 years ago
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆165Updated 2 years ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated last year
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆253Updated 2 years ago
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆409Updated last year
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆207Updated 2 years ago
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆326Updated last year
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆218Updated last year
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆238Updated 4 months ago
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆373Updated 2 years ago
• teticio / llama-squad
  Train Llama 2 & 3 on the SQuAD v2 task as an example of how to specialize a generalized (foundation) model.
  ☆53Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆484Updated last year
• huggingface / cosmopedia
  ☆561Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆72Updated last year
• jshuadvd / LongRoPE
  Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper
  ☆150Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆226Updated last year
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆205Updated last year
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆216Updated last year
• jakespringer / echo-embeddings
  ☆161Updated last year