gkamradt / LLMTest_NeedleInAHaystackLinks
Doing simple retrieval from LLM models at various context lengths to measure accuracy
☆1,867Updated 9 months ago
Alternatives and similar repositories for LLMTest_NeedleInAHaystack
Users that are interested in LLMTest_NeedleInAHaystack are comparing it to the libraries listed below
Sorting:
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,754Updated 5 months ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,712Updated this week
- AllenAI's post-training codebase☆2,986Updated this week
- Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI☆1,383Updated last year
- Data and tools for generating and inspecting OLMo pre-training data.☆1,220Updated last week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,563Updated last week
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆2,582Updated 4 months ago
- A library for advanced large language model reasoning☆2,132Updated last month
- YaRN: Efficient Context Window Extension of Large Language Models☆1,487Updated last year
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆2,087Updated last year
- Minimalistic large language model 3D-parallelism training☆1,888Updated last week
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆704Updated 2 months ago
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,534Updated last year
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,390Updated this week
- Code for Quiet-STaR☆732Updated 9 months ago
- 800,000 step-level correctness labels on LLM solutions to MATH problems☆1,999Updated last year
- Measuring Massive Multitask Language Understanding | ICLR 2021☆1,411Updated 2 years ago
- Efficient Retrieval Augmentation and Generation Framework☆1,540Updated 4 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆849Updated last week
- Evaluate your LLM's response with Prometheus and GPT4 💯☆945Updated last month
- Generative Representational Instruction Tuning☆639Updated 2 months ago
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,727Updated 9 months ago
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,248Updated 2 months ago
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters☆1,823Updated last year
- Official repository for ORPO☆453Updated last year
- Recipes to scale inference-time compute of open models☆1,073Updated last week
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆895Updated 3 months ago
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆944Updated 7 months ago
- MTEB: Massive Text Embedding Benchmark☆2,554Updated this week
- [NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention…☆1,035Updated this week