CentraleSupelec / aristote-dispatcherLinks
🔀 Deployement of LLM at a large scale using VLLM server for inference
☆26Updated this week
Alternatives and similar repositories for aristote-dispatcher
Users that are interested in aristote-dispatcher are comparing it to the libraries listed below
Sorting:
- Backend ressources for Albert. Albert is a conversational agent that uses official French data sources to answer administrative agents qu…☆121Updated this week
- Tracking instruction-tuned LLM openness. Paper: Liesenfeld, Andreas, Alianda Lopez, and Mark Dingemanse. 2023. “Opening up ChatGPT: Track…☆119Updated 5 months ago
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆42Updated last year
- ☆137Updated last year
- ☆41Updated 3 months ago
- Granite 3.1 Language Models☆117Updated last month
- ☆16Updated last month
- 👷 Build compute kernels☆93Updated this week
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆137Updated last year
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…☆66Updated last month
- NLP with Rust for Python 🦀🐍☆64Updated 2 months ago
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆79Updated last year
- AI Energy Score: Initiative to establish comparable energy efficiency ratings for AI models.☆30Updated 4 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 3 months ago
- FRP Fork☆175Updated 4 months ago
- A browser extension (for now only Chrome) that estimates the environmental impact of your AI interactions.☆13Updated last month
- ☆124Updated 9 months ago
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 10 months ago
- Voyage AI Official Python Library☆66Updated 2 weeks ago
- Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …☆59Updated 2 years ago
- A prompting library☆172Updated last month
- API de recherche et de consultation de la plateforme JUDILIBRE.☆19Updated this week
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- ☆63Updated 4 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆111Updated 4 months ago
- ForestFlow is a policy-driven Machine Learning Model Server. It is an LF AI Foundation incubation project.☆73Updated last year
- IBM development fork of https://github.com/huggingface/text-generation-inference☆61Updated 3 months ago
- Self-host LLMs with vLLM and BentoML☆140Updated this week
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆83Updated 7 months ago
- Inference engine for GLiNER models, in Rust☆64Updated last month