Alternatives and similar repositories for hf-hub-lightning

Users that are interested in hf-hub-lightning are comparing it to the libraries listed below

• nateraw / huggingface-datasets-converter
  Scripts to convert datasets from various sources to Hugging Face Datasets.
  ☆57Updated 3 years ago
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆87Updated last year
• patrickvonplaten / Wav2Vec2_PyCTCDecode
  Small repo describing how to use Hugging Face's Wav2Vec2 with PyCTCDecode
  ☆111Updated 3 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆96Updated 2 years ago
• mariosasko / datasets_sql
  Execute arbitrary SQL queries on 🤗 Datasets
  ☆32Updated last year
• sanchit-gandhi / seq2seq-speech
  Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax.
  ☆38Updated 2 years ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 3 years ago
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆85Updated this week
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆60Updated last year
• chuachinhon / wav2vec2_transformers
  Transcribing audio files using Hugging Face's implementation of Wav2Vec2 + "chain-linking" NLP tasks to combine speech-to-text with downs…
  ☆32Updated 4 years ago
• nateraw / spaces-docker-templates
  🚀🤗 A collection of templates for Hugging Face Spaces
  ☆35Updated 2 years ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 2 weeks ago
• comet-ml / blog-serving-hugging-face-models
  ☆20Updated 4 years ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆28Updated last year
• google-research / xtreme-up
  ☆52Updated 2 years ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated 2 years ago
• bigscience-workshop / data_sourcing
  This directory gathers the tools developed by the Data Sourcing Working Group
  ☆31Updated 4 years ago
• anton-l / wav2vec-toolkit
  A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models
  ☆30Updated 4 years ago
• applicaai / pyramidions
  This repository contains a demonstrative implementation for pooling-based models, e.g., DeepPyramidion complementing our paper "Sparsifyi…
  ☆14Updated 3 years ago
• infinitylogesh / mutate
  A library to synthesize text datasets using Large Language Models (LLM)
  ☆152Updated 2 years ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆60Updated last year
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆157Updated 2 years ago
• huggingface / tune
  ☆87Updated 3 years ago
• IamAdiSri / hf-trim
  Reduce the size of pretrained Hugging Face models via vocabulary trimming.
  ☆48Updated 3 years ago
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆87Updated last month
• masakhane-io / masakhane-ner
  ☆116Updated 2 months ago
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆35Updated 7 months ago
• neulab / newlang-tech
  A guide to building language technology in new languages.
  ☆59Updated 3 years ago
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆118Updated 4 years ago