Emerging-AI / ENOVALinks
A deployment, monitoring and autoscaling service towards serverless LLM serving.
☆151Updated last week
Alternatives and similar repositories for ENOVA
Users that are interested in ENOVA are comparing it to the libraries listed below
Sorting:
- ☆200Updated 2 months ago
- Support mixed-precsion inference with vllm☆84Updated 4 months ago
- Mixed precision inference by Tensorrt-LLM☆80Updated last year
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆178Updated 7 months ago
- Official implementation of RARE: Retrieval-Augmented Reasoning Modeling☆185Updated 6 months ago
- Source code and utilities for the Genesys distributed language model architecture discovery system.☆150Updated 2 months ago
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆184Updated 4 months ago
- official implementation of paper SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training☆42Updated last year
- This is a repo for my NanoGPT Pytorch2.0 Implementation when torch2.0 released soon, faster and simpler, a good tutorial learning GPT.☆50Updated last year
- Accurate, private and configurable document retrieval LLM☆131Updated 2 months ago
- A curated list of awesome leaderboard-oriented resources for large AI models☆298Updated this week
- A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]☆122Updated 6 months ago
- LLM Benchmark for Code☆32Updated last year
- MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction☆94Updated last year
- Collecting personality-indicative data for role-playing agents.☆23Updated 9 months ago
- 教你只用最基本的python语法和numpy一步步实现深度学习框架☆130Updated last year
- Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning (NeurIPS2026-SEA)☆78Updated 7 months ago
- 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力☆158Updated 2 months ago
- A ReAct-Based Highly Robust Autonomous Agent Framework.☆210Updated 3 months ago
- [ACL 2025 Findings] MegaAgent: A Large-Scale Autonomous LLM-based Multi-Agent System Without Predefined SOPs https://aclanthology.org/202…☆233Updated 3 weeks ago
- [NeurIPS 2024] EffiBench: Benchmarking the Efficiency of Automatically Generated Code☆58Updated last year
- Ein multimodaler, multi-intelligenter Entwicklungsrahmen☆45Updated 6 months ago
- ☆109Updated 2 weeks ago
- Source code for "CoEdPilot: Recommending Code Edits with Learned Prior Edit Relevance, Project-wise Awareness, and Interactive Nature"☆101Updated 8 months ago
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆83Updated 4 months ago
- Official code of "StreamBP: Memory-Efficient Exact Backpropagation for Long Sequence Training of LLMs".☆74Updated 5 months ago
- A general AI agent framework that can be adapted to various tasks and environments.☆103Updated 10 months ago
- This is an experimental demo repository of agent on data cleaning task☆70Updated 6 months ago
- OSAI: Your AI-powered OS assistant. Rename files, manage environment variables, set reminders, and control your system through natural la…☆94Updated last year
- SemiEvol: Semi-supervised Fine-tuning for LLM Adaptation☆57Updated 7 months ago