Alternatives and similar repositories for belebele

Users that are interested in belebele are comparing it to the libraries listed below

• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆178Updated 2 years ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆273Updated last year
• google-research-datasets / presto
  A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs
  ☆115Updated 2 years ago
• zeno-ml / zeno-build
  Build, evaluate, understand, and fix LLM-based apps
  ☆491Updated last year
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆214Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆262Updated 10 months ago
• salesforce / DialogStudio
  DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI
  ☆514Updated 9 months ago
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆97Updated 2 years ago
• sabetAI / BLoRA
  batched loras
  ☆347Updated 2 years ago
• jondurbin / bagel
  A bagel, with everything.
  ☆324Updated last year
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆188Updated 3 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆217Updated 2 years ago
• yxuansu / OpenAlpaca
  OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA
  ☆301Updated 2 years ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 5 months ago
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆482Updated 2 years ago
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆356Updated 2 years ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆250Updated 11 months ago
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆629Updated last year
• huggingface / cosmopedia
  ☆546Updated 11 months ago
• cisnlp / GlotLID
  💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
  ☆163Updated 4 months ago
• huggingface / llm_training_handbook
  An open collection of methodologies to help with successful training of large language models.
  ☆536Updated last year
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆212Updated last month
• salesforce / xgen
  Salesforce open-source LLMs with 8k sequence length.
  ☆722Updated 8 months ago
• linhduongtuan / BLOOM-LORA
  Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigs…
  ☆184Updated 2 years ago
• google-research / metricx
  ☆113Updated 10 months ago
• microsoft / MS-MARCO-Web-Search
  A large-scale information-rich web dataset, featuring millions of real clicked query-document labels
  ☆345Updated 10 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆581Updated last year
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆70Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆464Updated last year
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆108Updated 11 months ago