BobaZooba / xllm

Related projects: ⓘ

• philschmid / easyllm
  ☆429Updated 8 months ago
• huggingface / lighteval
  LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processin…
  ☆667Updated this week
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆237Updated last week
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆456Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆511Updated 4 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆306Updated 5 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆217Updated 6 months ago
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆469Updated last year
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆657Updated 5 months ago
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆371Updated 7 months ago
• Preemo-Inc / text-generation-inference
  ☆201Updated 7 months ago
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆508Updated 5 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆295Updated 3 months ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆195Updated 4 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆284Updated last month
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆322Updated 3 months ago
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆479Updated 11 months ago
• huggingface / cosmopedia
  ☆419Updated 2 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆213Updated last week
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆195Updated last month
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆180Updated 8 months ago
• alasdairforsythe / tokenmonster
  Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
  ☆545Updated 2 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆217Updated 2 months ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆1,408Updated this week
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆701Updated 11 months ago
• rasbt / LLM-finetuning-scripts
  ☆182Updated 7 months ago
• huggingface / huggingface-llama-recipes
  ☆276Updated 3 weeks ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆434Updated 5 months ago
• xhluca / bm25s
  Fast lexical search library implementing BM25 in Python using Numpy and Scipy
  ☆770Updated this week
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆212Updated 2 months ago