Alternatives and similar repositories for belebele

Users that are interested in belebele are comparing it to the libraries listed below

• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆267Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆260Updated 6 months ago
• prometheus-eval / prometheus
  [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…
  ☆300Updated last year
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆477Updated 2 years ago
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆208Updated 2 months ago
• salesforce / DialogStudio
  DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI
  ☆508Updated 5 months ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• huggingface / cosmopedia
  ☆524Updated 8 months ago
• sabetAI / BLoRA
  batched loras
  ☆344Updated last year
• philschmid / easyllm
  ☆460Updated last year
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆184Updated last week
• yxuansu / OpenAlpaca
  OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA
  ☆302Updated 2 years ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆232Updated 8 months ago
• salesforce / xgen
  Salesforce open-source LLMs with 8k sequence length.
  ☆719Updated 5 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆556Updated last year
• zeno-ml / zeno-build
  Build, evaluate, understand, and fix LLM-based apps
  ☆489Updated last year
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆352Updated 2 years ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆178Updated last year
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆219Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆94Updated last year
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆282Updated 4 months ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆144Updated last month
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆97Updated last year
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 2 months ago
• google-research / metricx
  ☆102Updated 7 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆322Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆338Updated 3 weeks ago
• microsoft / MS-MARCO-Web-Search
  A large-scale information-rich web dataset, featuring millions of real clicked query-document labels
  ☆338Updated 7 months ago
• project-miracl / miracl
  A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
  ☆190Updated 11 months ago
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆628Updated last year