ejhusom / MELODILinks
Use local Large Language Models (LLMs) while monitoring energy usage.
☆16Updated 2 months ago
Alternatives and similar repositories for MELODI
Users that are interested in MELODI are comparing it to the libraries listed below
Sorting:
- Building Knowledge Graph-Driven Chatbot with ChatGPT and ArangoDB☆20Updated 2 years ago
- End-to-end carbon footprint mod- eling tool☆52Updated 8 months ago
- A curated list of awesome Green AI resources and tools to assess and reduce the environmental impacts of using and deploying AI.☆102Updated last week
- Measure and optimize the energy consumption of your AI applications!☆332Updated last week
- ☆47Updated 9 months ago
- A canonical source of GenAI energy benchmark and meausrements☆50Updated 2 months ago
- An LLM-based coding mentor for your repository☆55Updated 2 years ago
- LLM Optimize is a proof-of-concept library for doing LLM (large language model) guided blackbox optimization.☆61Updated 2 years ago
- (Large) Language Tutor is an experimental LLM-powered language learning system☆26Updated last year
- ☆19Updated last year
- LLM-guided hyperparameter tuning☆10Updated 2 years ago
- ☆51Updated last year
- ACT An Architectural Carbon Modeling Tool for Designing Sustainable Computer Systems☆45Updated 6 months ago
- A collection of all available inference solutions for the LLMs☆94Updated 11 months ago
- A curated list of awesome resources, tools, research papers, and projects related to the concept of Large Language Model Operating System…☆152Updated this week
- Demo of Role-Based Access Control in LLM Vector Databases☆16Updated 2 years ago
- ☆102Updated last year
- Collection of resources for finetuning Large Language Models (LLMs).☆111Updated last year
- Self-host LLMs with LMDeploy and BentoML☆22Updated last month
- A calculator to estimate the memory footprint, capacity, and latency on VMware Private AI with NVIDIA.☆38Updated 6 months ago
- ☆30Updated last year
- TinyML & Edge AI: On-device inference, model quantization, embedded ML, ultra-low-power AI for microcontrollers and IoT devices.☆34Updated 3 months ago
- MathPrompter Implementation: This repository hosts an implementation based on the 'MathPrompter: Mathematical Reasoning Using Large Langu…☆14Updated 10 months ago
- A collection of LLM related papers, thesis, tools, datasets, courses, open source models, benchmarks☆61Updated last year
- Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents☆132Updated last year
- Estimating hardware and cloud costs of LLMs and transformer projects☆20Updated 3 weeks ago
- Solving Computer Vision with AI agents☆35Updated 7 months ago
- ☆64Updated 8 months ago
- ☆55Updated 5 months ago
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆44Updated last year