Alternatives and similar repositories for LLMTest_NeedleInAHaystack:

Users that are interested in LLMTest_NeedleInAHaystack are comparing it to the libraries listed below

• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 8 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆82Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 10 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 8 months ago
• AnswerDotAI / fastdata
  ☆151Updated 4 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆103Updated 4 months ago
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆86Updated 9 months ago
• abacaj / train-with-fsdp
  ☆92Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆77Updated 6 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆83Updated last month
• eugeneyan / visualizing-finetunes
  ☆78Updated 10 months ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆54Updated 8 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆223Updated 11 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆113Updated last year
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• jjallaire / inspect-llm-workshop
  ☆51Updated 10 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 9 months ago
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆89Updated last year
• normal-computing / extended-mind-transformers
  ☆117Updated 8 months ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆58Updated 2 months ago
• eugeneyan / align-app
  ☆66Updated 5 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 6 months ago
• BerriAI / bettertest
  ☆75Updated last year
• jxnl / n-levels-of-rag
  ☆194Updated 11 months ago
• haizelabs / verdict
  Verdict is a library for scaling judge-time compute.
  ☆193Updated 3 weeks ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆52Updated 4 months ago