tensorchord / llmspecLinks
OpenAI compatible API for open source LLMs
☆16Updated 2 years ago
Alternatives and similar repositories for llmspec
Users that are interested in llmspec are comparing it to the libraries listed below
Sorting:
- AI-based search done right☆20Updated last month
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆165Updated 2 years ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆279Updated 2 years ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated 2 years ago
- ☆67Updated 10 months ago
- Your own GPT-powered Personal Assistant to whom you can ORDER or INSTRUCT to do some task or search for something using your VOICE comman…☆20Updated 2 years ago
- Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…☆32Updated 8 months ago
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆275Updated 2 years ago
- Sentence Embedding as a Service☆15Updated 7 months ago
- Build multi-model chatbots and agents from intent.☆56Updated 2 weeks ago
- Opinionated Langchain setup with Qdrant vector store and Kong gateway☆33Updated 2 years ago
- ☆16Updated last year
- Turn any OCR models into online inference API endpoint 🚀 🌖☆57Updated 3 months ago
- Microsoft Phi 2 Streamlit App, deployed on HuggingFace Spaces is based on the Microsoft Phi 2 small language model (SLM) for text generat…☆14Updated last year
- LLM Agents: Landing Page Generation for an E-commerce Platform Using CrewAI, Groq-LangChain and Qdrant☆15Updated last year
- ProfitPilot closes deals for you effortlessly 24/7, just provide a list of customer and ProfitPilot will reach out on your behalf and clo…☆21Updated 2 years ago
- Open-source observability for your LLM application.☆53Updated last year
- Develop, evaluate and monitor LLM applications at scale☆99Updated last year
- Luann (fka TypeAgent) allows you to create many LLM based agent(Various types of agent,scale up)☆23Updated last month
- Smaug-72B topped the Hugging Face LLM leaderboard and it’s the first model with an average score of 80, making it the world’s best open-s…☆17Updated 9 months ago
- Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model☆23Updated last year
- TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p☆61Updated 6 months ago
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆57Updated last year
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 11 months ago
- Using LlamaIndex, Redis, and OpenAI to chat with PDF documents. Supplementary material for blog post on Microsoft Developer Blog☆114Updated 2 years ago
- ☆26Updated last year
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.☆58Updated last year
- 🤖 Sam-assistant is a personal assistant that is designed to understand your documents, search the internet, and in future versions, crea…☆52Updated 2 years ago
- CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search☆66Updated 6 months ago
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆41Updated 10 months ago