Alternatives and similar repositories for hf-hub-lightning

Users that are interested in hf-hub-lightning are comparing it to the libraries listed below

• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• patrickvonplaten / Wav2Vec2_PyCTCDecode
  Small repo describing how to use Hugging Face's Wav2Vec2 with PyCTCDecode
  ☆111Updated 2 years ago
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆83Updated 11 months ago
• mariosasko / datasets_sql
  Execute arbitrary SQL queries on 🤗 Datasets
  ☆32Updated last year
• nateraw / huggingface-datasets-converter
  Scripts to convert datasets from various sources to Hugging Face Datasets.
  ☆57Updated 2 years ago
• sanchit-gandhi / seq2seq-speech
  Repository for fine-tuning Transformers 🤗 based seq2seq speech models in JAX/Flax.
  ☆37Updated 2 years ago
• masakhane-io / lafand-mt
  MAFAND-MT
  ☆57Updated last year
• chuachinhon / wav2vec2_transformers
  Transcribing audio files using Hugging Face's implementation of Wav2Vec2 + "chain-linking" NLP tasks to combine speech-to-text with downs…
  ☆32Updated 4 years ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 3 years ago
• anton-l / wav2vec-toolkit
  A collection of scripts to preprocess ASR datasets and finetune language-specific Wav2Vec2 XLSR models
  ☆31Updated 4 years ago
• bigscience-workshop / data_tooling
  Tools for managing datasets for governance and training.
  ☆85Updated 2 weeks ago
• lgessler / microbert
  A tiny BERT for low-resource monolingual models
  ☆31Updated 11 months ago
• chandar-lab / NeoBERT
  ☆81Updated 2 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated 2 years ago
• IamAdiSri / hf-trim
  Reduce the size of pretrained Hugging Face models via vocabulary trimming.
  ☆45Updated 2 years ago
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆84Updated 9 months ago
• infinitylogesh / mutate
  A library to synthesize text datasets using Large Language Models (LLM)
  ☆152Updated 2 years ago
• nateraw / spaces-docker-templates
  🚀🤗 A collection of templates for Hugging Face Spaces
  ☆35Updated last year
• Vaibhavs10 / ml-with-audio
  HF's ML for Audio study group
  ☆195Updated 2 years ago
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated 2 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated 2 years ago
• huggingface / fuego
  [WIP] A 🔥 interface for running code in the cloud
  ☆85Updated 2 years ago
• google-research / metricx
  ☆106Updated 8 months ago
• huggingface / tune
  ☆87Updated 3 years ago
• huggingface / hffs
  **ARCHIVED** Filesystem interface to 🤗 Hub
  ☆58Updated 2 years ago
• patrickvonplaten / notebooks
  Some notebooks for NLP
  ☆207Updated last year
• sanchit-gandhi / codesnippets
  ☆10Updated last year