Alternatives and similar repositories for LLMTest_NeedleInAHaystack

Users that are interested in LLMTest_NeedleInAHaystack are comparing it to the libraries listed below

• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆80Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆103Updated 2 years ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆112Updated last year
• geronimi73 / phi2-finetune
  ☆86Updated 2 years ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆40Updated last year
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆55Updated 9 months ago
• teknium1 / transformers-gptq-quant
  ☆45Updated 2 years ago
• AnswerDotAI / fastdata
  ☆161Updated last year
• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆50Updated last year
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆99Updated 4 months ago
• SpellcraftAI / oaib
  Use the OpenAI Batch tool to make async batch requests to the OpenAI API.
  ☆101Updated last year
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated 2 years ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆82Updated last year
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆50Updated 2 years ago
• eugeneyan / visualizing-finetunes
  ☆79Updated last year
• instructor-ai / evals
  Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.
  ☆51Updated last year
• jacoblee93 / oss-model-extraction-evals
  ☆30Updated last year
• normal-computing / extended-mind-transformers
  ☆125Updated last year
• abacaj / train-with-fsdp
  ☆94Updated 2 years ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆53Updated 11 months ago
• HazyResearch / eclair-agents
  Automating enterprise workflows with multimodal agents
  ☆115Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆51Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated 2 years ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆72Updated last year
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 11 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated 2 years ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated 2 years ago