Emerging-AI / ENOVALinks
A deployment, monitoring and autoscaling service towards serverless LLM serving.
☆153Updated this week
Alternatives and similar repositories for ENOVA
Users that are interested in ENOVA are comparing it to the libraries listed below
Sorting:
- Support mixed-precsion inference with vllm☆85Updated last month
- Mixed precision inference by Tensorrt-LLM☆81Updated 10 months ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆178Updated 4 months ago
- Official implementation of RARE: Retrieval-Augmented Reasoning Modeling☆183Updated 3 months ago
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆185Updated last month
- This is a repo for my NanoGPT Pytorch2.0 Implementation when torch2.0 released soon, faster and simpler, a good tutorial learning GPT.☆52Updated last year
- Accurate, private and configurable document retrieval LLM☆130Updated 2 months ago
- A curated list of awesome leaderboard-oriented resources for foundation models☆280Updated last week
- A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]☆121Updated 3 months ago
- official implementation of paper SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training☆40Updated 8 months ago
- MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction☆93Updated 9 months ago
- [ACL 2025 Findings] MegaAgent: A Large-Scale Autonomous LLM-based Multi-Agent System Without Predefined SOPs https://arxiv.org/abs/2408.0…☆181Updated 3 weeks ago
- 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力☆156Updated last month
- Collecting personality-indicative data for role-playing agents.☆23Updated 6 months ago
- A scalable, end-to-end training pipeline for general-purpose agents☆354Updated last month
- This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …☆45Updated last year
- 教你只用最基本的python语法和numpy一步步实现深度学习框架☆129Updated last year
- Official code of "StreamBP: Memory-Efficient Exact Backpropagation for Long Sequence Training of LLMs".☆68Updated 2 months ago
- SQL-o1: A Self-Reward Heuristic Dynamic Search Method for Text-to-SQL☆190Updated 3 months ago
- Framework exploring ergonomic, lightweight multi-agent orchestration.☆116Updated this week
- Source code for "CoEdPilot: Recommending Code Edits with Learned Prior Edit Relevance, Project-wise Awareness, and Interactive Nature"☆101Updated 4 months ago
- A ReAct-Based Highly Robust Autonomous Agent Framework.☆208Updated this week
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆75Updated last month
- Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning☆76Updated 4 months ago
- OSAI: Your AI-powered OS assistant. Rename files, manage environment variables, set reminders, and control your system through natural la…☆94Updated last year
- ☆100Updated this week
- DocAgent is a system designed to generate high-quality, context-aware code documentation for Python codebases using a multi-agent approac…☆310Updated 4 months ago
- LLM Benchmark for Code☆30Updated last year
- A MongoDB-compatible, high-performance, elastic, distributed document database.☆160Updated this week
- [ACL 2025 Best Theme Paper] This is the official implementation for the paper: "Meta-rater: A Multi-dimensional Data Selection Method for…☆162Updated 3 weeks ago