Knowledgator / TurboT5

Related projects: ⓘ

• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆60Updated this week
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆42Updated 10 months ago
• conceptofmind / flash-gpt
  ☆34Updated this week
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆91Updated last year
• allenai / bff
  ☆38Updated 5 months ago
• castorini / hf-spacerini
  Plug-and-play Search Interfaces with Pyserini and Hugging Face
  ☆32Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆52Updated 5 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆109Updated 2 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆81Updated 2 weeks ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated last year
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆82Updated 6 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆42Updated 3 weeks ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆48Updated last week
• conceptofmind / SemDeDup
  ☆18Updated this week
• mgmalek / efficient_cross_entropy
  ☆66Updated 3 months ago
• applicaai / CCpdf
  Index of URLs to pdf files all over the internet and scripts
  ☆20Updated last year
• hadasah / btm
  ☆69Updated 4 months ago
• shayne-longpre / a-pretrainers-guide
  ☆73Updated last year
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆54Updated last month
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• hltcoe / ColBERT-X
  CLIR version of ColBERT
  ☆62Updated 3 months ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆69Updated 7 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆57Updated 5 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆27Updated 2 months ago
• Zyphra / Zyda_processing
  ☆22Updated 3 months ago
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆80Updated 6 months ago
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆72Updated 6 months ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆56Updated last week
• google-deepmind / xtr
  XTR: Rethinking the Role of Token Retrieval in Multi-Vector Retrieval
  ☆33Updated 2 months ago
• facebookresearch / BELA
  Bi-encoder entity linking architecture
  ☆40Updated last week