Alternatives and similar repositories for LLMTest_NeedleInAHaystack

Users that are interested in LLMTest_NeedleInAHaystack are comparing it to the libraries listed below

• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆103Updated 2 years ago
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆112Updated last year
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• geronimi73 / phi2-finetune
  ☆86Updated 2 years ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆99Updated 4 months ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆55Updated 9 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆50Updated 2 years ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• jacoblee93 / oss-model-extraction-evals
  ☆30Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆40Updated last year
• eugeneyan / visualizing-finetunes
  ☆79Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated 2 years ago
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆92Updated last year
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆166Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆72Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated 2 years ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆69Updated 2 months ago
• normal-computing / extended-mind-transformers
  ☆125Updated last year
• abacaj / train-with-fsdp
  ☆94Updated 2 years ago
• BerriAI / bettertest
  ☆75Updated 2 years ago
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆82Updated last year
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆126Updated 3 months ago
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆84Updated last year
• ravi03071991 / KT_Generator
  Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.
  ☆77Updated 2 years ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated last year