Alternatives and similar repositories for common-pile

Users that are interested in common-pile are comparing it to the libraries listed below

• marzenakrp / nocha
  ☆51Updated 8 months ago
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 7 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆133Updated 5 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆97Updated 4 months ago
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆43Updated 6 months ago
• mungg / FABLES
  ☆57Updated 9 months ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆236Updated 3 months ago
• Pleias / marginalia
  ☆67Updated last year
• Pleias / Pleias-RAG-Library
  Python library to use Pleias-RAG models
  ☆57Updated last month
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• LAION-AI / AIW
  Alice in Wonderland code base for experiments and raw experiments data
  ☆131Updated 4 months ago
• Aleph-Alpha-Research / trigrams
  ☆56Updated last month
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆25Updated 6 months ago
• cognitivecomputations / spectrum
  ☆124Updated 2 months ago
• allenai / bff
  ☆38Updated last year
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆78Updated 6 months ago
• epfml / DenseFormer
  ☆81Updated last year
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 3 months ago
• Alex-Gurung / ReasoningNCP
  Official repo for Learning to Reason for Long-Form Story Generation
  ☆63Updated 2 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆87Updated 8 months ago
• google-deepmind / mishax
  ☆134Updated 2 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆64Updated last year
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆58Updated last month
• Pleias / OCRoscope
  Small python package to measure OCR quality and other related metrics.
  ☆23Updated last year
• AnswerDotAI / fastkmeans
  ☆61Updated last week
• LAGoM-NLP / transtokenizer
  ☆48Updated 5 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆261Updated 11 months ago
• stanford-crfm / fmti
  The Foundation Model Transparency Index
  ☆81Updated last year
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆195Updated last month