Emerging-AI / ENOVA
A deployment, monitoring and autoscaling service towards serverless LLM serving.
☆150Updated last week
Alternatives and similar repositories for ENOVA:
Users that are interested in ENOVA are comparing it to the libraries listed below
- Support mixed-precsion inference with vllm☆80Updated 2 months ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆174Updated 3 months ago
- Mixed precision inference by Tensorrt-LLM☆76Updated 4 months ago
- A Contamination-free Multi-task Language Understanding Benchmark☆114Updated 2 months ago
- MIXQ: Taming Dynamic Outliers in Mixed-Precision Quantization by Online Prediction☆80Updated 4 months ago
- An acceleration library that supports arbitrary bit-width combinatorial quantization operations☆216Updated 5 months ago
- Common AI agent framework solving your data problems☆124Updated last week
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆240Updated 6 months ago
- LLM Benchmark for Code☆31Updated 7 months ago
- Accurate, private and configurable document retrieval LLM☆120Updated last week
- A Contextual RAG Bot Framework☆80Updated 4 months ago
- The Official Repo of ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://a…☆289Updated 3 months ago
- ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference☆151Updated 4 months ago
- JittorGeometric is a Jittor-based graph machine learning library.☆150Updated last month
- A curated list of awesome leaderboard-oriented resources for foundation models☆257Updated last week
- Collecting personality-indicative data for role-playing agents.☆22Updated 3 weeks ago
- AI powered tools playground☆124Updated last year
- AI solution for Patent Classification☆144Updated 4 years ago
- This is a repo for my NanoGPT Pytorch2.0 Implementation when torch2.0 released soon, faster and simpler, a good tutorial learning GPT.☆52Updated last year
- ☆184Updated this week
- A Tiny structure of pytorch for learning;☆56Updated 8 months ago
- AutoRLAIF is a cutting-edge framework designed to revolutionize the fine-tuning of large language models through Reinforcement Learning …☆93Updated 4 months ago
- [EMNLP 2024] DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models☆63Updated 4 months ago
- OSAI: Your AI-powered OS assistant. Rename files, manage environment variables, set reminders, and control your system through natural la…☆87Updated 6 months ago
- This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …☆45Updated last year
- TxBKG - Knowledge Graph Generation for Any PDFs☆181Updated 3 months ago
- An ultra-lightweight agentic AI framework based on the ReAct paradigm.☆187Updated this week
- A framework to build GUI-like Agent Tools, enhancement to Function Calling of LLM AI.☆94Updated 4 months ago
- [ACL2024 Findings] Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM☆56Updated last week