r-three / common-pileLinks
Code for collecting, processing, and preparing datasets for the Common Pile
☆222Updated last week
Alternatives and similar repositories for common-pile
Users that are interested in common-pile are comparing it to the libraries listed below
Sorting:
- Python library to use Pleias-RAG models☆61Updated 4 months ago
- ☆67Updated last year
- ☆185Updated 2 months ago
- ☆57Updated 11 months ago
- Small python package to measure OCR quality and other related metrics.☆25Updated last year
- An introduction to LLM Sampling☆79Updated 8 months ago
- code for training & evaluating Contextual Document Embedding models☆197Updated 3 months ago
- ☆78Updated 2 weeks ago
- ☆247Updated 5 months ago
- minimal pytorch implementation of bm25 (with sparse tensors)☆104Updated last year
- Alice in Wonderland code base for experiments and raw experiments data☆131Updated last month
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆63Updated 3 weeks ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 6 months ago
- ☆134Updated 2 weeks ago
- Code for SaGe subword tokenizer (EACL 2023)☆26Updated 9 months ago
- ☆63Updated 3 weeks ago
- ☆81Updated 3 months ago
- Pre-train Static Word Embeddings☆84Updated 3 months ago
- Let's build better datasets, together!☆263Updated 8 months ago
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆186Updated last month
- ☆31Updated 9 months ago
- ☆49Updated 6 months ago
- ☆52Updated 10 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated last year
- ☆58Updated 3 months ago
- Pretraining Efficiently on S2ORC!☆166Updated 10 months ago
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…☆66Updated 2 months ago
- Evaluating LLMs with fewer examples☆160Updated last year
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆44Updated last month