firstbatchxyz / function-calling-eval
The DPAB-α Benchmark
☆19Updated 2 months ago
Alternatives and similar repositories for function-calling-eval:
Users that are interested in function-calling-eval are comparing it to the libraries listed below
- Nexusflow function call, tool use, and agent benchmarks.☆19Updated 3 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆43Updated last week
- Run AI generated code in isolated sandboxes☆45Updated last month
- Open source implementation for computer use, using light OCR models and LLMs.☆14Updated this week
- ☆22Updated 2 months ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆59Updated 10 months ago
- Simple examples using Argilla tools to build AI☆52Updated 4 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆59Updated 7 months ago
- ☆66Updated 10 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 2 months ago
- ☆23Updated 4 months ago
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- ☆17Updated last week
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Using modal.com to process FineWeb-edu data☆20Updated 3 weeks ago
- ☆99Updated 7 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆46Updated 5 months ago
- ☆38Updated last year
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆76Updated 3 months ago
- Distributed Inference for mlx LLm☆87Updated 8 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆60Updated 8 months ago
- LLM-as-SERP☆59Updated last month
- A high performance batching router optimises max throughput for text inference workload☆16Updated last year
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- ☆47Updated 11 months ago
- Embed anything.☆29Updated 10 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.☆21Updated last month
- ☆111Updated 3 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆84Updated 3 weeks ago
- A couple scripts to grab stats from email☆42Updated 6 months ago