CoderPat / croissant-llm-training

Related projects ⓘ

Alternatives and complementary repositories for croissant-llm-training

• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆202Updated 3 months ago
• jphme / EM_German
  Repository for the EM German Model
  ☆104Updated 11 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆242Updated last week
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆52Updated 3 months ago
• bjoernpl / lm-evaluation-harness-de
  A framework for few-shot evaluation of autoregressive language models.
  ☆13Updated 8 months ago
• huggingface / cosmopedia
  ☆447Updated 2 weeks ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆460Updated 7 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆236Updated 4 months ago
• bjoernpl / GermanBenchmark
  A repository containing the code for translating popular LLM benchmarks to German.
  ☆24Updated last year
• cognitivecomputations / spectrum
  ☆92Updated last month
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆261Updated 3 months ago
• mixedbread-ai / batched
  ☆106Updated 3 weeks ago
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆194Updated 6 months ago
• langtech-bsc / salamandra
  ☆20Updated this week
• neuml / txtinstruct
  📚 Datasets and models for instruction-tuning
  ☆231Updated last year
• AnswerDotAI / bert24
  ☆64Updated this week
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆239Updated 2 weeks ago
• teelinsan / camoscio
  Camoscio: An Italian instruction-tuned language model based on LLaMA
  ☆126Updated 11 months ago
• Preemo-Inc / text-generation-inference
  ☆200Updated 9 months ago
• Pleias / marginalia
  ☆68Updated 8 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆354Updated last month
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆150Updated 2 months ago
• taylorai / galactic
  data cleaning and curation for unstructured text
  ☆327Updated 3 months ago
• Vaibhavs10 / optimise-my-whisper
  ☆188Updated 5 months ago
• tomaarsen / SpanMarkerNER
  SpanMarker for Named Entity Recognition
  ☆398Updated 3 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆794Updated this week
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆161Updated 2 weeks ago
• raphaelsty / neural-cherche
  Neural Search
  ☆344Updated 5 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆162Updated 6 months ago
• ScandEval / ScandEval
  Evaluation of language models on mono- or multilingual tasks.
  ☆74Updated this week
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆219Updated last week