Emerging-AI / ENOVALinks
A deployment, monitoring and autoscaling service towards serverless LLM serving.
☆151Updated last week
Alternatives and similar repositories for ENOVA
Users that are interested in ENOVA are comparing it to the libraries listed below
Sorting:
- ☆204Updated 4 months ago
- Support mixed-precsion inference with vllm☆84Updated 6 months ago
- Mixed precision inference by Tensorrt-LLM☆80Updated last year
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆180Updated 9 months ago
- Official implementation of RARE: Retrieval-Augmented Reasoning Modeling☆186Updated 8 months ago
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆187Updated 6 months ago
- [ACL 2025 Findings] MegaAgent: A Large-Scale Autonomous LLM-based Multi-Agent System Without Predefined SOPs https://aclanthology.org/202…☆233Updated 2 months ago
- A curated list of awesome leaderboard-oriented resources for AI domain☆299Updated last week
- This is a repo for my NanoGPT Pytorch2.0 Implementation when torch2.0 released soon, faster and simpler, a good tutorial learning GPT.☆50Updated last year
- MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction☆94Updated last year
- A general AI agent framework that can be adapted to various tasks and environments.☆150Updated 11 months ago
- official implementation of paper SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training☆44Updated last year
- A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]☆121Updated 8 months ago
- Accurate, private and configurable document retrieval LLM☆131Updated 4 months ago
- Source code and utilities for the Genesys distributed language model architecture discovery system.☆164Updated 3 months ago
- Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning (NeurIPS2025-SEA)☆80Updated 9 months ago
- 教你只用最基本的python语法和numpy一步步实现深度学习框架☆130Updated last year
- A ReAct-Based Highly Robust Autonomous Agent Framework.☆210Updated 5 months ago
- 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力☆160Updated 3 months ago
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆90Updated 2 weeks ago
- ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.098…☆317Updated 5 months ago
- A scalable, end-to-end training pipeline for general-purpose agents☆362Updated 6 months ago
- Collecting personality-indicative data for role-playing agents.☆23Updated 11 months ago
- This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …☆45Updated 2 years ago
- A general-purpose API load testing platform that supports LLM services and business HTTP interfaces, enabling one-click performance testi…☆110Updated 2 weeks ago
- Official code of "StreamBP: Memory-Efficient Exact Backpropagation for Long Sequence Training of LLMs".☆74Updated 7 months ago
- Framework exploring ergonomic, lightweight multi-agent orchestration.☆117Updated 2 months ago
- Ein multimodaler, multi-intelligenter Entwicklungsrahmen☆44Updated 7 months ago
- ☆187Updated 3 weeks ago
- Source code for "CoEdPilot: Recommending Code Edits with Learned Prior Edit Relevance, Project-wise Awareness, and Interactive Nature"☆102Updated 9 months ago