firstbatchxyz / function-calling-eval
The DPAB-α Benchmark
☆21Updated 4 months ago
Alternatives and similar repositories for function-calling-eval
Users that are interested in function-calling-eval are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 3 months ago
- ☆25Updated 3 months ago
- Run AI generated code in isolated sandboxes☆71Updated 3 months ago
- Nexusflow function call, tool use, and agent benchmarks.☆19Updated 5 months ago
- Simple examples using Argilla tools to build AI☆52Updated 5 months ago
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆51Updated last week
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆61Updated this week
- Distributed Inference for mlx LLm☆91Updated 9 months ago
- ☆66Updated 11 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆47Updated 7 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆87Updated 3 weeks ago
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- ☆15Updated 11 months ago
- ☆53Updated 11 months ago
- Scripts to create your own moe models using mlx☆89Updated last year
- inference code for mixtral-8x7b-32kseqlen☆100Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hours☆61Updated 8 months ago
- Dria SDK is for building and executing synthetic data generation pipelines on Dria Knowledge Network.☆24Updated last month
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆90Updated 3 months ago
- A super simple web interface to perform blind tests on LLM outputs.☆28Updated last year
- The one who calls upon functions - Function-Calling Language Model☆36Updated last year
- TOPLOC: is a novel method for verifiable inference that enables users to verify that LLM providers are using the correct model configurat…☆30Updated last month
- ☆28Updated 5 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆80Updated 5 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated 6 months ago
- Editor with LLM generation tree exploration☆66Updated 3 months ago
- Train your own SOTA deductive reasoning model☆92Updated 2 months ago
- look how they massacred my boy☆63Updated 7 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 11 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆60Updated 9 months ago