Alternatives and similar repositories for knowledge-distillation-transformers-pytorch-sagemaker

Users that are interested in knowledge-distillation-transformers-pytorch-sagemaker are comparing it to the libraries listed below

• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆299Updated last month
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆253Updated last year
• nelson-liu / lost-in-the-middle
  Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
  ☆351Updated last year
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆85Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆459Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆105Updated 2 years ago
• naver / bergen
  Benchmarking library for RAG
  ☆216Updated last week
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆127Updated 11 months ago
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆397Updated last year
• AI21Labs / in-context-ralm
  ☆284Updated last year
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆245Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆467Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆94Updated last year
• princeton-nlp / AutoCompressors
  [EMNLP 2023] Adapting Language Models to Compress Long Contexts
  ☆308Updated 10 months ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• AIR-Bench / AIR-Bench
  AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆150Updated 7 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆222Updated 8 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆338Updated 3 weeks ago
• night-chen / ToolQA
  ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …
  ☆272Updated last year
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆204Updated 7 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆267Updated last year
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆214Updated last year
• huggingface / cosmopedia
  ☆524Updated 8 months ago
• teticio / llama-squad
  Train Llama 2 & 3 on the SQuAD v2 task as an example of how to specialize a generalized (foundation) model.
  ☆52Updated last year
• ParticleMedia / RAGTruth
  Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"
  ☆192Updated 7 months ago
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆225Updated 4 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆242Updated 8 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 9 months ago
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆200Updated last year