Alternatives and similar repositories for croissant-llm-training

Users that are interested in croissant-llm-training are comparing it to the libraries listed below

• bjoernpl / lm-evaluation-harness-de
  A framework for few-shot evaluation of autoregressive language models.
  ☆13Updated last year
• EuroEval / EuroEval
  The robust European language model benchmark.
  ☆133Updated this week
• jphme / EM_German
  Repository for the EM German Model
  ☆112Updated last year
• betagouv / ComparIA
  Interroger à l'aveugle deux modèles de langage conversationnels sur des tâches exprimées en français et comparer les résultats.
  ☆45Updated this week
• OpenLLM-France / Manifesto
  Page de préconfiguration de la communauté OpenLLM-France
  ☆48Updated last year
• MoritzLaurer / prompt_templates
  A library for working with prompt templates locally or on the Hugging Face Hub.
  ☆50Updated 7 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆263Updated 10 months ago
• bofenghuang / vigogne
  French instruction-following and chat models
  ☆506Updated 10 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆62Updated last year
• bjoernpl / GermanBenchmark
  A repository containing the code for translating popular LLM benchmarks to German.
  ☆30Updated 2 years ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆163Updated 4 months ago
• huggingface / fineweb-2
  ☆201Updated last week
• genai-impact / ecologits
  🌱 EcoLogits tracks the energy consumption and environmental footprint of using generative AI models through APIs.
  ☆225Updated last week
• MoritzLaurer / synthetic-data-blog
  This is the reproduction repository for my 🤗 Hugging Face blog post on synthetic data
  ☆68Updated last year
• r-three / common-pile
  Code for collecting, processing, and preparing datasets for the Common Pile
  ☆235Updated last month
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆581Updated last year
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆632Updated this week
• QuixiAI / spectrum
  ☆136Updated 2 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆408Updated last month
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆188Updated 3 months ago
• KennethEnevoldsen / scandinavian-embedding-benchmark
  A Scandinavian Benchmark for sentence embeddings
  ☆41Updated 5 months ago
• AI-Commandos / LLaMa2lang
  Convenience scripts to finetune (chat-)LLaMa3 and other models for any language
  ☆316Updated last year
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆494Updated last year
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆249Updated last year
• Babelscape / FENICE
  FENICE (Factuality Evaluation of Summarization based on Natural Language Inference and Claim Extraction) is a factuality-oriented metric …
  ☆28Updated 11 months ago
• hitz-zentroa / GoLLIE
  Guideline following Large Language Model for Information Extraction
  ☆404Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆332Updated 6 months ago
• johko / awesome-german-open-source-ml
  A list of awesome open source projects in the machine learning field, who's developers are mainly based in Germany
  ☆48Updated last year
• IBM / unitxt
  🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …
  ☆211Updated this week
• huggingface / huggingface-llama-recipes
  ☆687Updated 6 months ago