aniketmaurya / fastserve-ai
Machine Learning Serving focused on GenAI with simplicity as the top priority.
☆58Updated 3 weeks ago
Alternatives and similar repositories for fastserve-ai:
Users that are interested in fastserve-ai are comparing it to the libraries listed below
- ☆77Updated 11 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 6 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 9 months ago
- ☆101Updated 8 months ago
- ☆12Updated last year
- Simple examples using Argilla tools to build AI☆52Updated 5 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 4 months ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆136Updated 9 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆80Updated 11 months ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆16Updated last year
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆47Updated 8 months ago
- 🤝 Trade any tensors over the network☆30Updated last year
- Build Agentic workflows with function calling using open LLMs☆26Updated 3 weeks ago
- ☆66Updated 11 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆80Updated 4 months ago
- Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU☆32Updated last year
- Set of scripts to finetune LLMs☆37Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆105Updated 3 weeks ago
- Fine-tune an LLM to perform batch inference and online serving.☆110Updated this week
- ☆19Updated 8 months ago
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆37Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆67Updated 6 months ago
- Text to Python Objects via a LLM Function Call☆57Updated last year
- Solving data for LLMs - Create quality synthetic datasets!☆146Updated 3 months ago
- ☆43Updated 2 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆76Updated 2 months ago
- Running load tests on a FastAPI application using Locust☆15Updated last month
- ☆123Updated 6 months ago
- ☆31Updated 5 months ago