Alternatives and similar repositories for QLoRA-for-MLM

Users that are interested in QLoRA-for-MLM are comparing it to the libraries listed below

• JuChunHuang / protein-variants-generation

  View on GitHub
  Generating Protein Variants with Different Generative Models (HMM, VAE, ESM-2, ProtGPT2)
  ☆11Mar 14, 2024Updated last year
• castorini / hf-spacerini

  View on GitHub
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Aug 5, 2023Updated 2 years ago
• IBM / auto-contrastive-generation

  View on GitHub
  Text generation using language models with multiple exit heads
  ☆16Sep 18, 2025Updated 4 months ago
• somewheresystems / llama2mlx

  View on GitHub
  Karpathy's llama2.c transpiled to MLX for Apple Silicon
  ☆14Dec 28, 2023Updated 2 years ago
• KUIS-AI / Arabic-ALBERT

  View on GitHub
  Arabic edition of ALBERT pretrained language models
  ☆16Apr 25, 2021Updated 4 years ago
• CarperAI / treasure_trove

  View on GitHub
  ☆22Aug 27, 2023Updated 2 years ago
• huggingface / wikirace-llms

  View on GitHub
  ☆25May 7, 2025Updated 9 months ago
• VikParuchuri / textbook_quality

  View on GitHub
  Generate textbook-quality synthetic LLM pretraining data
  ☆509Oct 19, 2023Updated 2 years ago
• alon-albalak / FLAD

  View on GitHub
  Few-shot Learning with Auxiliary Data
  ☆31Dec 8, 2023Updated 2 years ago
• saurabhaloneai / Llama-3-From-Scratch-In-Pure-Jax

  View on GitHub
  This repository contain the simple llama3 implementation in pure jax.
  ☆71Feb 17, 2025Updated 11 months ago
• ltgoslo / ltg-bert

  View on GitHub
  LTG-Bert
  ☆34Jan 8, 2024Updated 2 years ago
• RulinShao / retrieval-scaling

  View on GitHub
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆224Dec 16, 2025Updated last month
• deep-diver / gpt2-ft-pipeline

  View on GitHub
  GPT2 fine-tuning pipeline with KerasNLP, TensorFlow, and TensorFlow Extended
  ☆33Sep 6, 2023Updated 2 years ago
• microsoft / mutransformers

  View on GitHub
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆87Mar 14, 2022Updated 3 years ago
• nicholasyager / llama-cpp-guidance

  View on GitHub
  A guidance compatibility layer for llama-cpp-python
  ☆36Sep 11, 2023Updated 2 years ago
• project-miracl / hagrid

  View on GitHub
  A Human-LLM Collaborative Dataset for Generative Information-seeking with Attribution
  ☆35Aug 2, 2023Updated 2 years ago
• BiolApps / VaccineDesigner

  View on GitHub
  R Shiny application "Vaccine Designer" aiming for the construction of vaccine sequences based on multi epitope design workflow.
  ☆10Jun 25, 2024Updated last year
• latynt / ans

  View on GitHub
  Arabic News Stance Corpus
  ☆11Feb 5, 2021Updated 5 years ago
• Sanofi-Public / mRNA-LM

  View on GitHub
  ☆18Dec 5, 2024Updated last year
• VikParuchuri / libgen_to_txt

  View on GitHub
  Convert all of libgen to high quality markdown
  ☆254Dec 13, 2023Updated 2 years ago
• Zyphra / Zyda_processing

  View on GitHub
  ☆42Jun 19, 2024Updated last year
• austinsilveria / tricksy

  View on GitHub
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆39Jan 4, 2024Updated 2 years ago
• huggingface / olm-training

  View on GitHub
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆96Feb 9, 2023Updated 3 years ago
• LUMIA-Group / LoT-insts

  View on GitHub
  The official implementation of the paper "Text Classification in the Wild: a Large-scale Long-tailed Name Normalization Dataset"(ICASSP 2…
  ☆12Feb 19, 2023Updated 2 years ago
• google-research / robel-scenes

  View on GitHub
  Shared MuJoCo simulation scenes and assets for ROBEL environments.
  ☆14Jul 31, 2020Updated 5 years ago
• tyler-romero / microR1

  View on GitHub
  Simple repository for training small reasoning models
  ☆49Feb 6, 2025Updated last year
• ni-lab / finetuning-enformer

  View on GitHub
  Code for improving the performance of sequence-to-expression models for making individual-specific gene expression predictions by fine-tu…
  ☆15Dec 12, 2025Updated 2 months ago
• surajt97 / Train_Delay_Prediction

  View on GitHub
  Predicting train delay using previous weather and delay information of trains
  ☆11Oct 25, 2017Updated 8 years ago
• talkpython / llm-building-blocks-for-python-course

  View on GitHub
  LLM Building Blocks for Python Course
  ☆15Nov 17, 2025Updated 2 months ago
• LiLabTsinghua / Course-AI-EnzymeDesign

  View on GitHub
  This is for the AI enzyme design course
  ☆13Nov 10, 2025Updated 3 months ago
• potamides / uniformers

  View on GitHub
  Token-free Language Modeling with ByGPT5 & Friends!
  ☆12Jul 18, 2025Updated 6 months ago
• jeffpierce / memory-palace

  View on GitHub
  Persistent memory system for agentic AI via MCP - remember, recall, forget with semantic search with knowledge graph
  ☆24Updated this week
• hieudx149 / X-RetroMAE

  View on GitHub
  Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder
  ☆10Mar 16, 2023Updated 2 years ago
• tushar117 / XAlign

  View on GitHub
  Cross-lingual Fact-to-Text Alignment and Generation for Low-Resource Languages
  ☆11Jan 1, 2023Updated 3 years ago
• jjroberts88 / transcriber

  View on GitHub
  Conversion of audio files to text using whisper from OpenAI with a simple tkinter GUI
  ☆10Apr 13, 2023Updated 2 years ago
• R-Gaurav / train-delay-estimation

  View on GitHub
  An open source project on estimating train delays in India.
  ☆11Oct 29, 2018Updated 7 years ago
• Boadzie / sensor-dashboard

  View on GitHub
  ☆18Jun 25, 2025Updated 7 months ago
• HUPO-PSI / psi-mod-CV

  View on GitHub
  PSI-MOD ontology for modified and unmodified amino acid residues
  ☆14Jan 8, 2026Updated last month
• microsoft / SDR

  View on GitHub
  Self-Supervised Document-to-Document Similarity Ranking via Contextualized Language Models and Hierarchical Inference
  ☆45Nov 28, 2022Updated 3 years ago