jxmorris12 / bm25_ptLinks
minimal pytorch implementation of bm25 (with sparse tensors)
☆101Updated last year
Alternatives and similar repositories for bm25_pt
Users that are interested in bm25_pt are comparing it to the libraries listed below
Sorting:
- Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).☆80Updated last year
- ☆57Updated 2 weeks ago
- Crispy reranking models by Mixedbread☆31Updated last month
- ☆46Updated 3 years ago
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆56Updated this week
- Pre-train Static Word Embeddings☆70Updated this week
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- experiments with inference on llama☆104Updated 11 months ago
- ☆38Updated last year
- XTR: Rethinking the Role of Token Retrieval in Multi-Vector Retrieval☆51Updated 11 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆136Updated last week
- Datasets collection and preprocessings framework for NLP extreme multitask learning☆182Updated 4 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆89Updated 6 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆128Updated last year
- CLIR version of ColBERT☆67Updated last month
- ☆43Updated 3 months ago
- Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"☆25Updated 2 months ago
- Supercharge huggingface transformers with model parallelism.☆77Updated 7 months ago
- NLP with Rust for Python 🦀🐍☆62Updated 3 weeks ago
- ☆29Updated last year
- A library for squeakily cleaning and filtering language datasets.☆46Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆78Updated 8 months ago
- ☆43Updated 3 months ago
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆25Updated 2 years ago
- ☆57Updated 8 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- ☆62Updated 10 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 9 months ago
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 7 months ago