AlexBodner / How_Much_VRAM
☆101Updated 8 months ago
Alternatives and similar repositories for How_Much_VRAM:
Users that are interested in How_Much_VRAM are comparing it to the libraries listed below
- Simple examples using Argilla tools to build AI☆52Updated 5 months ago
- ☆112Updated 4 months ago
- ☆57Updated 2 months ago
- ☆171Updated 8 months ago
- Scripts to create your own moe models using mlx☆89Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆58Updated 3 weeks ago
- ☆53Updated 11 months ago
- Solving data for LLMs - Create quality synthetic datasets!☆146Updated 3 months ago
- ☆66Updated 11 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆60Updated 8 months ago
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆93Updated 4 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆80Updated 11 months ago
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆38Updated 7 months ago
- Own your AI, search the web with it🌐😎☆85Updated 3 months ago
- ☆85Updated 7 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆67Updated 6 months ago
- Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB☆119Updated last year
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆22Updated last month
- Video+code lecture on building nanoGPT from scratch☆66Updated 10 months ago
- ☆131Updated 2 weeks ago
- ☆43Updated 2 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 6 months ago
- Embed anything.☆29Updated 11 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆105Updated 3 weeks ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆70Updated this week
- A prompting library☆163Updated 7 months ago
- Self-host LLMs with vLLM and BentoML☆107Updated this week
- A pipeline parallel training script for LLMs.☆139Updated this week
- An automated tool for discovering insights from research papaer corpora☆138Updated 10 months ago
- Distributed Inference for mlx LLm☆89Updated 9 months ago