spapicchio / QATCH
Official implementation of QATCH: Benchmarking SQL-centric tasks with Table Representation Learning Models on Your Data
☆25Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for QATCH
- ☆166Updated last year
- Interpretability for sequence generation models 🐛 🔍☆374Updated this week
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆193Updated 9 months ago
- ☆332Updated 11 months ago
- A python package for benchmarking interpretability techniques on Transformers.☆211Updated last month
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆230Updated last year
- Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"☆430Updated last year
- Scalable training for dense retrieval models.☆270Updated last year
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆322Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆159Updated last year
- Benchmarking library for RAG☆112Updated this week
- Multilingual Large Language Models Evaluation Benchmark☆105Updated 2 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆122Updated 7 months ago
- [NAACL'24] Dataset, code and models for "TableLlama: Towards Open Large Generalist Models for Tables".☆113Updated 5 months ago
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆289Updated 5 months ago
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆114Updated last month
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆110Updated 7 months ago
- Inquisitive Parrots for Search☆177Updated 8 months ago
- ITALIC: An ITALian Intent Classification Dataset☆11Updated 11 months ago
- A framework for few-shot evaluation of autoregressive language models.☆101Updated last year
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆408Updated 8 months ago
- Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …☆132Updated last month
- Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"☆258Updated 9 months ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆467Updated 4 months ago
- Code and Data for "Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering"☆78Updated 2 months ago
- Train Llama 2 & 3 on the SQuAD v2 task as an example of how to specialize a generalized (foundation) model.☆47Updated 5 months ago
- What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets☆188Updated 2 months ago
- Use Large Language Models like OpenAI's GPT-3.5 for data annotation and model enhancement. This framework combines human expertise with L…☆29Updated last year
- A Survey on Data Selection for Language Models☆178Updated 3 weeks ago
- RARR: Researching and Revising What Language Models Say, Using Language Models☆43Updated last year