A high-throughput and memory-efficient inference and serving engine for LLMs
β13Nov 27, 2023Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) trainingβ19Apr 26, 2022Updated 3 years ago
- π€ Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.β11Mar 2, 2022Updated 3 years ago
- Your friendly investment advisor has now turned into an LLM chatbot!β14Mar 24, 2024Updated last year
- A multimodal RAG application that enables semantic search on multimedia sources like audio, video and imagesβ41Nov 18, 2023Updated 2 years ago
- Finetune Your Local LLMβ18Sep 23, 2023Updated 2 years ago
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.β20Jun 3, 2024Updated last year
- A UI code generation tool for the OthersideAI/chronology packageβ50Jan 11, 2021Updated 5 years ago
- β30Jun 19, 2023Updated 2 years ago
- quick playground to animate pippinβ14Nov 11, 2024Updated last year
- This Python project integrates MetaTrader5 with GPT-4 to generate automated trading signals. It analyzes OHLC and tick data to provide reβ¦β12Aug 25, 2024Updated last year
- A set of jupyter notebooksβ27Dec 18, 2024Updated last year
- Data Structures with Python(AIX20001) κ°μ μλ£μ€β18Jun 14, 2024Updated last year
- A simple interface for using Ollama with LangChain's RAGChainβ30Mar 5, 2024Updated last year
- Open source NLA. Hosted service in private beta, signup now! Alternative to Zapier NLAβ29Nov 20, 2023Updated 2 years ago
- Codebase for fine-tuning Llama2 70B to generate math test questions and answers.β11Aug 30, 2024Updated last year
- A MATLAB app to interactively navigate Ryze Tello drone, read navigation data, process image data and produce equivalent MATLAB code. Thiβ¦β13Oct 22, 2025Updated 4 months ago
- A Terminal User Interface (TUI) application that enables interactive conversations with your documents using Large Language Models (LLM) β¦β13Dec 11, 2024Updated last year
- A simple Sentiment Analysis API in FastAPI.β15Dec 17, 2024Updated last year
- An experiment to see if we can process G2 reviews to extract topics from reviewsβ10Feb 5, 2024Updated 2 years ago
- Python bindings for upgraded FaCT++ description logic reasonerβ29Feb 1, 2026Updated last month
- Awesome AI for chemistry papersβ44May 20, 2023Updated 2 years ago
- Websockify is a WebSocket to TCP proxy/bridge. This allows a browser to connect to any application/server/service. Implementations in Pyβ¦β28Nov 7, 2016Updated 9 years ago
- The multiplatform connector program for most robots supported by the Open Roberta Lab.β13May 21, 2024Updated last year
- fine-tuning tutorialβ18Feb 20, 2026Updated last week
- User-friendly viewer for Parquet filesβ10Jan 10, 2026Updated last month
- DOS Program Developmentβ13Nov 9, 2022Updated 3 years ago
- The best way to practice interview questionsβ14Apr 25, 2023Updated 2 years ago
- [ICRA 2026] StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenesβ20Feb 17, 2026Updated last week
- Artificial Intelligence based model for classifying different wood species based on specific vibration characteristics.β10Mar 24, 2021Updated 4 years ago
- Interact with ChatGPT and GPT-4 in alternative waysβ13Mar 17, 2024Updated last year
- MCP server for Google search and page fetching using headless Chromiumβ67Feb 21, 2026Updated last week
- Import a Motor-CAD Thermal Model into Simulink and Simscapeβ16Jul 22, 2025Updated 7 months ago
- MiniMax-Provider-Verifier offers a rigorous, vendor-agnostic way to verify whether third-party deployments of the Minimax M2 model are coβ¦β28Feb 18, 2026Updated last week
- β10Nov 14, 2022Updated 3 years ago
- Awesome darkforest related reposβ41May 7, 2022Updated 3 years ago
- Robot control infrastructureβ25Jul 6, 2016Updated 9 years ago
- Open source Python program for automating gain staging. part 1 of a series for automating audio processing tasks, end goal is to create aβ¦β46Oct 4, 2023Updated 2 years ago
- β10Jan 9, 2024Updated 2 years ago
- Lumenera USB camera interface.β12Mar 27, 2024Updated last year