Alternatives and similar repositories for function-calling-eval

Users that are interested in function-calling-eval are comparing it to the libraries listed below

• weaviate-tutorials / Hurricane
  Writing Blog Posts with Generative Feedback Loops!
  ☆48Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 10 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 7 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 7 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 8 months ago
• davidberenstein1957 / dataset-viber
  Dataset Viber is your chill repo for data collection, annotation and vibe checks.
  ☆47Updated 9 months ago
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆87Updated 11 months ago
• teknium1 / transformers-gptq-quant
  ☆47Updated last year
• cognitivecomputations / kraken
  ☆66Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆47Updated 4 months ago
• cognitivecomputations / SystemChat
  ☆30Updated 11 months ago
• teknium1 / ShareGPT-Builder
  ☆114Updated 6 months ago
• Muhtasham / summarization-eval
  📝 Reference-Free automatic summarization evaluation with potential hallucination detection
  ☆100Updated last year
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆64Updated last year
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆70Updated 7 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆99Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year
• davanstrien / data-for-fine-tuning-llms
  ☆77Updated last year
• axolotl-ai-cloud / grpo_code
  A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
  ☆27Updated 2 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆86Updated 2 weeks ago
• mourad-ghafiri / OpenMindedChatbot
  OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…
  ☆29Updated last year
• rawsh / mirrorllm
  ☆17Updated 5 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆49Updated 11 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆80Updated 3 months ago
• jacoblee93 / oss-model-extraction-evals
  ☆31Updated last year
• angelina-yang / Claude_API_Contest
  Claude API Test Project
  ☆87Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• brendanhogan / picoDeepResearch
  ☆63Updated 3 weeks ago
• zbambergerNLP / strategic-debate-tot
  A DSPy-based implementation of the tree of thoughts method (Yao et al., 2023) for generating persuasive arguments
  ☆81Updated 8 months ago