msclar / formatspreadLinks
Code accompanying "How I learned to start worrying about prompt formatting".
☆112Updated 4 months ago
Alternatives and similar repositories for formatspread
Users that are interested in formatspread are comparing it to the libraries listed below
Sorting:
- Evaluating LLMs with fewer examples☆163Updated last year
- Code repo for "Agent Instructs Large Language Models to be General Zero-Shot Reasoners"☆116Updated this week
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆153Updated last year
- ☆155Updated last year
- MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]☆186Updated last month
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆144Updated 11 months ago
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆117Updated 2 years ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆242Updated 11 months ago
- Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering☆190Updated 8 months ago
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆135Updated last week
- Official Implementation of InstructZero; the first framework to optimize bad prompts of ChatGPT(API LLMs) and finally obtain good prompts…☆196Updated last year
- Functional Benchmarks and the Reasoning Gap☆89Updated last year
- ☆312Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆135Updated last year
- ☆128Updated last year
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆98Updated 10 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated last year
- PASTA: Post-hoc Attention Steering for LLMs☆125Updated 11 months ago
- 🚢 Data Toolkit for Sailor Language Models☆94Updated 8 months ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆148Updated 11 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆163Updated last year
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- Complex Function Calling Benchmark.☆139Updated 9 months ago
- Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory☆143Updated 5 months ago
- Open Implementations of LLM Analyses☆107Updated last year
- A set of utilities for running few-shot prompting experiments on large-language models☆123Updated 2 years ago
- ☆149Updated last year
- ☆74Updated last year
- A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper…☆127Updated last year
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆87Updated last year