WhereIsAI / BiLLM
Tool for converting LLMs from uni-directional to bi-directional by removing causal mask for tasks like classification and sentence embeddings. Compatible with 🤗 transformers.
☆56Updated 4 months ago
Alternatives and similar repositories for BiLLM:
Users that are interested in BiLLM are comparing it to the libraries listed below
- Rethinking Negative Instances for Generative Named Entity Recognition [ACL 2024 Findings]☆51Updated last year
- ☆43Updated 3 months ago
- Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval☆45Updated 6 months ago
- Leveraging passage embeddings for efficient listwise reranking with large language models.☆40Updated 5 months ago
- Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"☆80Updated last year
- ☆34Updated 10 months ago
- ☆7Updated 2 years ago
- [ACL 2024 Findings] Learning Fine-Grained Grounded Citations for Attributed Large Language Models☆18Updated 6 months ago
- Implementation of paper: HLATR: Enhance Multi-stage Text Retrieval with Hybrid List Aware Transformer Reranking☆67Updated 2 years ago
- A framework for editing the CoTs for better factuality☆51Updated last year
- [ACL 2024] FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models☆98Updated 2 weeks ago
- ☆32Updated last year
- Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"☆101Updated 2 years ago
- ☆67Updated last year
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆78Updated 5 months ago
- Finetune mistral-7b-instruct for sentence embeddings☆81Updated last year
- ☆17Updated 10 months ago
- This is a meta-model distilled from LLMs for information extraction. This is an intermediate checkpoint that can be well-transferred to a…☆27Updated 2 months ago
- ☆117Updated 2 years ago
- ☆44Updated 3 years ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆150Updated 8 months ago
- Dual Cross Encoder for Dense Retrieval☆16Updated 2 years ago
- SNCSE: Contrastive Learning for Unsupervised Sentence Embedding with Soft Negative Samples☆75Updated 2 years ago
- Code and dataset for the emnlp paper titled Instruct and Extract: Instruction Tuning for On-Demand Information Extraction☆52Updated last year
- Towards Systematic Measurement for Long Text Quality☆34Updated 8 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- [Neurips2023] Source code for Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory☆59Updated last year
- ConTextual Mask Auto-Encoder for Dense Passage Retrieval☆35Updated 6 months ago
- Collection of scripts to pretrain T5 in unsupervised text, using PyTorch Lightning. CORD-19 pretraining provided as example.☆32Updated 4 years ago
- [EMNLP 2022] Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning☆134Updated last year