Alternatives and similar repositories for function-calling-eval

Users that are interested in function-calling-eval are comparing it to the libraries listed below

• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆48Updated last year
• teknium1 / transformers-gptq-quant
  ☆48Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆118Updated 10 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆86Updated last week
• instructor-ai / evals
  Using various instructor clients evaluating the quality and capabilities of extractions and reasoning.
  ☆51Updated 8 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 6 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆40Updated last year
• teknium1 / ShareGPT-Builder
  ☆113Updated 5 months ago
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated 11 months ago
• cognitivecomputations / SystemChat
  ☆30Updated 10 months ago
• davidberenstein1957 / dataset-viber
  Dataset Viber is your chill repo for data collection, annotation and vibe checks.
  ☆47Updated 8 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆38Updated 3 weeks ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆90Updated 4 months ago
• stunningpixels / lou-eval
  Track the progress of LLM context utilisation
  ☆53Updated last month
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 6 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆99Updated last year
• redotvideo / pluto
  Synthetic Data for LLM Fine-Tuning
  ☆116Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆92Updated 2 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 3 months ago
• jacoblee93 / oss-model-extraction-evals
  ☆31Updated last year
• Technoculture / personal-graph
  Simple Graph Memory for AI applications
  ☆86Updated 2 weeks ago
• lancedb / ragged
  ☆19Updated 7 months ago
• emrgnt-cmplxty / SmolTrainer
  ☆19Updated last year
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆60Updated 10 months ago
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆70Updated 7 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆78Updated 2 months ago
• arcee-ai / DAM
  ☆49Updated 6 months ago
• mickymultani / RAG-with-Cross-Encoder-Reranker
  Testing speed and accuracy of RAG with, and without Cross Encoder Reranker.
  ☆48Updated last year