Alternatives and similar repositories for text-generation-inference-tests

Users that are interested in text-generation-inference-tests are comparing it to the libraries listed below

• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆48Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆104Updated 5 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• cognitivecomputations / SystemChat
  ☆30Updated 11 months ago
• jamesmurdza / agenteval
  Automated testing and benchmarking for code generation agents.
  ☆18Updated last year
• pacman100 / peft-codegen-25
  ☆23Updated last year
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆40Updated last year
• garg-ankush / scipe
  SCIPE is a powerful tool for evaluating and diagnosing LLM (Large Language Model) graphs or chains.
  ☆24Updated 7 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 10 months ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆53Updated last month
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 10 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• jacoblee93 / oss-model-extraction-evals
  ☆31Updated last year
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆77Updated 3 months ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆30Updated 8 months ago
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 months ago
• andrewnguonly / ChatAbstractions
  LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
  ☆81Updated last year
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• diicellman / dspy-gradio-rag
  RAG example using DSPy, Gradio, FastAPI
  ☆80Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆54Updated 6 months ago
• aymeric-roucher / LongContext_vs_RAG_NeedleInAHaystack
  Comparing retrieval abilities from GPT4-Turbo and a RAG system on a toy example for various context lengths
  ☆35Updated last year
• huggingface / hf-endpoints-documentation
  ☆17Updated 2 weeks ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 5 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 10 months ago
• yujonglee / eval
  Evaluate your LLM apps, RAG pipeline, any generated text, and more!
  ☆1Updated last year
• CarperAI / treasure_trove
  ☆22Updated last year
• timlrx / simple-ai-agents
  Simple AI agents / assistants
  ☆45Updated 7 months ago
• unicamp-dl / InRanker
  ☆48Updated last year
• Hannibal046 / nanoColBERT
  Simple replication of [ColBERT-v1](https://arxiv.org/abs/2004.12832).
  ☆80Updated last year