Emerging-AI / ENOVALinks
A deployment, monitoring and autoscaling service towards serverless LLM serving.
☆152Updated this week
Alternatives and similar repositories for ENOVA
Users that are interested in ENOVA are comparing it to the libraries listed below
Sorting:
- Support mixed-precsion inference with vllm☆85Updated 6 months ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆178Updated 2 months ago
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆185Updated last month
- Mixed precision inference by Tensorrt-LLM☆80Updated 8 months ago
- Accurate, private and configurable document retrieval LLM☆126Updated 2 weeks ago
- Official implementation of RARE: Retrieval-Augmented Reasoning Modeling☆181Updated last month
- A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]☆117Updated last month
- A curated list of awesome leaderboard-oriented resources for foundation models☆276Updated last week
- [ACL 2025 Findings] MegaAgent: A Large-Scale Autonomous LLM-based Multi-Agent System Without Predefined SOPs https://arxiv.org/abs/2408.0…☆46Updated last month
- DocAgent is a system designed to generate high-quality, context-aware code documentation for Python codebases using a multi-agent approac…☆280Updated 2 months ago
- This is a repo for my NanoGPT Pytorch2.0 Implementation when torch2.0 released soon, faster and simpler, a good tutorial learning GPT.☆52Updated last year
- A scalable, end-to-end training pipeline for general-purpose agents☆258Updated last week
- MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction☆91Updated 8 months ago
- A ReAct-Based Highly Robust Autonomous Agent Framework.☆209Updated 2 months ago
- [ICML 2025] "SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator"☆175Updated last week
- Collecting personality-indicative data for role-playing agents.☆23Updated 4 months ago
- Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning☆75Updated 2 months ago
- 教你只用最基本的python语法和numpy一步步实现深度学习框架☆130Updated 11 months ago
- LLM Benchmark for Code☆30Updated 11 months ago
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆70Updated last month
- official implementation of paper SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training☆38Updated 7 months ago
- Official code of "StreamBP: Memory-Efficient Exact Backpropagation for Long Sequence Training of LLMs".☆67Updated 2 weeks ago
- OSAI: Your AI-powered OS assistant. Rename files, manage environment variables, set reminders, and control your system through natural la…☆94Updated 10 months ago
- Source code for "CoEdPilot: Recommending Code Edits with Learned Prior Edit Relevance, Project-wise Awareness, and Interactive Nature"☆101Updated 3 months ago
- 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力☆154Updated last year
- Create your self-hosted, open-source Operator model.☆100Updated 3 months ago
- SQL-o1: A Self-Reward Heuristic Dynamic Search Method for Text-to-SQL☆185Updated last month
- ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.098…☆301Updated last week
- A general AI agent framework that can be adapted to various tasks and environments.☆100Updated 5 months ago
- ClipSift is a tool for you to automatically speed up content / asset searching. By providing a natural lanaguage description, you can eas…☆41Updated last year