cisnlp / GlotCC

Related projects ⓘ

Alternatives and complementary repositories for GlotCC

• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆22Updated 8 months ago
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆20Updated last year
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆12Updated this week
• ChrisHayduk / QLoRA-for-MLM
  QLoRA for Masked Language Modeling
  ☆20Updated last year
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆49Updated last week
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆40Updated 8 months ago
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆22Updated 2 months ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆23Updated 6 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆46Updated 2 months ago
• wang-kee / LiNeS
  ☆21Updated last week
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆55Updated 2 months ago
• facebookresearch / mexma
  MEXMA: Token-level objectives improve sentence representations
  ☆32Updated this week
• fdschmidt93 / trident-nllb-llm2vec
  Repository for "Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages"
  ☆13Updated last month
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• gautierdag / tokenizer-bench
  Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"
  ☆11Updated 8 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 3 months ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated 8 months ago
• Aleph-Alpha / trigrams
  ☆43Updated 2 months ago
• ltgoslo / ltg-bert
  LTG-Bert
  ☆29Updated 10 months ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆22Updated last month
• prateeky2806 / ComPEFT
  ☆25Updated 11 months ago
• Zyphra / Zyda_processing
  ☆26Updated 4 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• knoriy / CLARA
  ☆61Updated 3 months ago
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated 10 months ago
• AlexWan0 / infini-gram
  An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)
  ☆24Updated 4 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆21Updated 2 weeks ago