Alternatives and similar repositories for belebele

Users that are interested in belebele are comparing it to the libraries listed below

• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆271Updated last year
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated 2 years ago
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆479Updated 2 years ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆263Updated 9 months ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆160Updated 3 months ago
• yxuansu / OpenAlpaca
  OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA
  ☆302Updated 2 years ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆219Updated 2 years ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆186Updated 2 months ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆268Updated 4 months ago
• google-research-datasets / presto
  A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs
  ☆115Updated 2 years ago
• salesforce / DialogStudio
  DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI
  ☆516Updated 7 months ago
• huggingface / cosmopedia
  ☆539Updated 10 months ago
• microsoft / MS-MARCO-Web-Search
  A large-scale information-rich web dataset, featuring millions of real clicked query-document labels
  ☆341Updated 9 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆573Updated last year
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆212Updated 4 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆232Updated 10 months ago
• zeno-ml / zeno-build
  Build, evaluate, understand, and fix LLM-based apps
  ☆491Updated last year
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆287Updated 6 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆324Updated last year
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆215Updated last year
• sabetAI / BLoRA
  batched loras
  ☆345Updated 2 years ago
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆188Updated last year
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆97Updated 2 years ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆342Updated 2 months ago
• project-miracl / miracl
  A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
  ☆194Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆628Updated last year
• google-research / metricx
  ☆110Updated 9 months ago
• prometheus-eval / prometheus
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…
  ☆306Updated last year
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆171Updated last year