tensorchord / llmspecLinks
OpenAI compatible API for open source LLMs
☆16Updated last year
Alternatives and similar repositories for llmspec
Users that are interested in llmspec are comparing it to the libraries listed below
Sorting:
- AI-based search done right☆20Updated 3 weeks ago
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆167Updated 2 years ago
- Opinionated Langchain setup with Qdrant vector store and Kong gateway☆33Updated 2 years ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆274Updated last year
- Develop, evaluate and monitor LLM applications at scale☆100Updated 9 months ago
- Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…☆28Updated 3 months ago
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆276Updated last year
- Python client library for improving your LLM app accuracy☆98Updated 7 months ago
- AI Agent capable of automating various tasks using MCP☆38Updated 5 months ago
- ☆64Updated 5 months ago
- TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p☆58Updated 2 months ago
- Pipeline is an open source python SDK for building AI/ML workflows☆138Updated last year
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆56Updated last year
- Create chatbot and AI agent workflows with unified access.☆53Updated 3 months ago
- Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model☆23Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained de…☆49Updated last year
- Open-source observability for your LLM application.☆53Updated 8 months ago
- Smaug-72B topped the Hugging Face LLM leaderboard and it’s the first model with an average score of 80, making it the world’s best open-s…☆17Updated 5 months ago
- Build Phone Calling Voice Agent fully powered by open source models.☆56Updated 5 months ago
- LLM Agents: Landing Page Generation for an E-commerce Platform Using CrewAI, Groq-LangChain and Qdrant☆14Updated last year
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.☆54Updated last year
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆38Updated 6 months ago
- Using LlamaIndex, Redis, and OpenAI to chat with PDF documents. Supplementary material for blog post on Microsoft Developer Blog☆114Updated last year
- An embeddable widget for interacting with openAI api compatable LLM's☆11Updated last year
- An JS web client for connecting to Pipecat bots with voice and vision☆45Updated 9 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆72Updated last year
- Code generation with LLMs 🔗☆53Updated 2 years ago
- Open Sourced NoteBookLM☆59Updated 11 months ago
- Sentence Embedding as a Service☆15Updated 2 months ago