Alternatives and similar repositories for LLMTest_NeedleInAHaystack

Users that are interested in LLMTest_NeedleInAHaystack are comparing it to the libraries listed below

• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 10 months ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆118Updated 10 months ago
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆103Updated 5 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 11 months ago
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆99Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated last year
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆116Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• jxnl / n-levels-of-rag
  ☆194Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆53Updated last month
• angelina-yang / Claude_API_Contest
  Claude API Test Project
  ☆87Updated last year
• geronimi73 / phi2-finetune
  ☆87Updated last year
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year
• AnswerDotAI / fastdata
  ☆152Updated 6 months ago
• fw-ai / cookbook
  Collection of recipes aiding Gen AI model development
  ☆109Updated last week
• allenai / CommonGen-Eval
  Evaluating LLMs with CommonGen-Lite
  ☆90Updated last year
• abacaj / train-with-fsdp
  ☆92Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆167Updated last year
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆87Updated 10 months ago
• teknium1 / ShareGPT-Builder
  ☆113Updated 5 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆63Updated last year
• normal-computing / extended-mind-transformers
  ☆119Updated 9 months ago
• eugeneyan / visualizing-finetunes
  ☆77Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆92Updated 2 months ago
• leehanchung / lora-instruct
  Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
  ☆101Updated last week
• interstellarninja / MeeseeksAI
  A framework for orchestrating AI agents using a mermaid graph
  ☆75Updated last year