tensorchord / llmspecLinks
OpenAI compatible API for open source LLMs
☆16Updated last year
Alternatives and similar repositories for llmspec
Users that are interested in llmspec are comparing it to the libraries listed below
Sorting:
- AI-based search done right☆20Updated last week
- Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…☆26Updated 4 months ago
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆164Updated 2 years ago
- Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)☆275Updated last year
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)☆275Updated 2 years ago
- a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant☆56Updated last year
- Smaug-72B topped the Hugging Face LLM leaderboard and it’s the first model with an average score of 80, making it the world’s best open-s…☆17Updated 5 months ago
- Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…☆39Updated 6 months ago
- TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p☆58Updated 2 months ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 7 months ago
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.☆55Updated last year
- Sentence Embedding as a Service☆15Updated 3 months ago
- ☆16Updated last year
- Create chatbot and AI agent workflows with unified access.☆53Updated 4 months ago
- Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model☆23Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Open-source observability for your LLM application.☆52Updated 9 months ago
- Opinionated Langchain setup with Qdrant vector store and Kong gateway☆32Updated 2 years ago
- AI Agent capable of automating various tasks using MCP☆37Updated 6 months ago
- Develop, evaluate and monitor LLM applications at scale☆98Updated 10 months ago
- Python client library for improving your LLM app accuracy☆98Updated 8 months ago
- This project provides a Flask-based API for generating high-quality text-to-speech (TTS) audio using F5-TTS, a flexible and powerful TTS …☆14Updated 2 months ago
- A Python program leveraging OpenAI's language models to generate, analyze, and select the best answer to a given question.☆46Updated last year
- Build Phone Calling Voice Agent fully powered by open source models.☆56Updated 5 months ago
- how to build a sentence embedding application using BentoML☆15Updated 6 months ago
- ☆64Updated 6 months ago
- Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.☆118Updated last year
- Co-Coder is a Python package that streamlines error debugging from Open AI chat GPT and Google Bard by providing hints, example code, and …☆46Updated 2 years ago
- Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.☆72Updated last year
- Code generation with LLMs 🔗☆53Updated 2 years ago