Alternatives and similar repositories for LLMTest_NeedleInAHaystack

Users that are interested in LLMTest_NeedleInAHaystack are comparing it to the libraries listed below

• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆106Updated 7 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 11 months ago
• teknium1 / transformers-gptq-quant
  ☆47Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆49Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 11 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• BerriAI / bettertest
  ☆75Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated last year
• geronimi73 / phi2-finetune
  ☆87Updated last year
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆83Updated 9 months ago
• zetaalphavector / RAGElo
  RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker
  ☆113Updated this week
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆167Updated last year
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆55Updated 2 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆43Updated last year
• ravi03071991 / KT_Generator
  Repository of the code base for KT Generation process that we worked at Google Cloud and Searce GenAI Hackathon.
  ☆74Updated last year
• AnswerDotAI / fastdata
  ☆154Updated 7 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆168Updated last year
• angelina-yang / Claude_API_Contest
  Claude API Test Project
  ☆87Updated last year
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆87Updated last year
• abacaj / train-with-fsdp
  ☆92Updated last year
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆119Updated last year
• instructor-ai / evals
  Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.
  ☆52Updated 9 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆90Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆64Updated last year
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆323Updated 8 months ago