tensorchord / llmspecLinks
OpenAI compatible API for open source LLMs
☆16Updated last year
Alternatives and similar repositories for llmspec
Users that are interested in llmspec are comparing it to the libraries listed below
Sorting:
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆167Updated last year
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆56Updated 11 months ago
- Simple Implementation of a Transformer in the new framework MLX by Apple☆20Updated 9 months ago
- AI-based search done right☆20Updated 3 weeks ago
- This repository contains statistics about the AI Infrastructure products.☆17Updated 6 months ago
- Luann (fka TypeAgent) allows you to create many LLM based agent(Various types of agent,scale up)☆21Updated 4 months ago
- Self-host llmapi server, make it really easy for accessing LLMs !☆37Updated 2 years ago
- Opinionated Langchain setup with Qdrant vector store and Kong gateway☆33Updated 2 years ago
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆276Updated last year
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆272Updated last year
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆71Updated last year
- TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p☆58Updated last month
- ⚡ Instantly turn your python function into web app.☆39Updated 2 years ago
- AI Agent capable of automating various tasks using MCP☆38Updated 4 months ago
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆38Updated 5 months ago
- Develop, evaluate and monitor LLM applications at scale☆100Updated 9 months ago
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.☆54Updated last year
- Perform facts checks on your conversations with LLMs to catch fake-news, misleading information, and LLMs confusion.☆12Updated 2 years ago
- ☆16Updated last year
- Probably one of the lightest native RAG + Agent apps out there,experience the power of Agent-powered models and Agent-driven knowledge ba…☆28Updated 3 months ago
- Create chatbot and AI agent workflows with unified access.☆53Updated 3 months ago
- Python client library for improving your LLM app accuracy☆98Updated 6 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- ☆63Updated 5 months ago
- ProfitPilot closes deals for you effortlessly 24/7, just provide a list of customer and ProfitPilot will reach out on your behalf and clo…☆21Updated last year
- Chat AI (↓↓Scroll to see more↓↓)☆28Updated last year
- Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model☆23Updated 11 months ago
- Open-source observability for your LLM application.☆53Updated 8 months ago
- A Python program leveraging OpenAI's language models to generate, analyze, and select the best answer to a given question.☆47Updated last year
- Open Sourced NoteBookLM☆59Updated 11 months ago