CentraleSupelec / aristote-dispatcherLinks
🔀 Deployement of LLM at a large scale using VLLM server for inference
☆28Updated 2 weeks ago
Alternatives and similar repositories for aristote-dispatcher
Users that are interested in aristote-dispatcher are comparing it to the libraries listed below
Sorting:
- API de recherche et de consultation de la plateforme JUDILIBRE.☆22Updated 3 weeks ago
- Backend ressources for Albert. Albert is a conversational agent that uses official French data sources to answer administrative agents qu…☆121Updated 4 months ago
- Interroger à l'aveugle deux modèles de langage conversationnels sur des tâches exprimées en français et comparer les résultats.☆56Updated last week
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆44Updated last year
- ☆17Updated 5 months ago
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, including…☆68Updated 3 weeks ago
- Tracking instruction-tuned LLM openness. Paper: Liesenfeld, Andreas, Alianda Lopez, and Mark Dingemanse. 2023. “Opening up ChatGPT: Track…☆119Updated 9 months ago
- NLP with Rust for Python 🦀🐍☆70Updated 7 months ago
- A toolkit for exhaustively modeling the environmental impact of digital services.☆15Updated last week
- ClearML Fractional GPU - Run multiple containers on the same GPU with driver level memory limitation ✨ and compute time-slicing☆88Updated last month
- 🌱 EcoLogits tracks the energy consumption and environmental footprint of using generative AI models through APIs.☆244Updated last month
- This project defines a json ontology standard describing a power consumption measure in a given software/hardware context, noticeably in …☆15Updated last month
- The official evaluation suite and dynamic data release for MixEval.☆11Updated last year
- Continual pretraining of foundation LLM using ⚡ Lightning Fabric☆37Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated 3 months ago
- Datamodels for hugging face tokenizers☆86Updated last month
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆139Updated last year
- Customize, control, and enhance LLM generation with logits processors, featuring visualization capabilities to inspect and understand sta…☆39Updated last week
- Inference engine for GLiNER models, in Rust☆81Updated last month
- Code for continual pretraining of LUCIE☆50Updated 3 weeks ago
- Command Line Interface for Hugging Face Inference Endpoints☆66Updated last year
- Python library to use Pleias-RAG models☆67Updated 7 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆48Updated last year
- LCA as Code - Domain-Specific Language for Life-Cycle Analysis☆14Updated 2 months ago
- Model implementation for the contextual embeddings project☆37Updated 6 months ago
- A curated list of awesome Green AI resources and tools to assess and reduce the environmental impacts of using and deploying AI.☆99Updated 2 weeks ago
- ☆28Updated 9 months ago
- Efficiently find the best-suited language model (LM) for your NLP task☆132Updated 5 months ago
- Your buddy in the (L)LM space.☆64Updated last year
- ☆45Updated 2 months ago