aniketmaurya / fastserve-aiLinks
Machine Learning Serving focused on GenAI with simplicity as the top priority.
β59Updated last week
Alternatives and similar repositories for fastserve-ai
Users that are interested in fastserve-ai are comparing it to the libraries listed below
Sorting:
- β77Updated last year
- πΉοΈ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.β137Updated 11 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafteβ¦β73Updated 8 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β33Updated 2 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absoluteβ¦β49Updated last year
- β101Updated 10 months ago
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.β47Updated 10 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing β‘β66Updated 8 months ago
- β210Updated 2 weeks ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectioβ¦β81Updated last year
- Build Agentic workflows with function calling using open LLMsβ28Updated last week
- β57Updated 2 weeks ago
- Simple examples using Argilla tools to build AIβ53Updated 7 months ago
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K β¦β83Updated 6 months ago
- β75Updated last year
- Solving data for LLMs - Create quality synthetic datasets!β150Updated 5 months ago
- Fine-tune an LLM to perform batch inference and online serving.β112Updated last month
- β106Updated last week
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Modelsβ108Updated 3 months ago
- Unattended Lightweight Text Classifiers with LLM Embeddingsβ185Updated 10 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.β82Updated this week
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.β38Updated 10 months ago
- Efficient vector database for hundred millions of embeddings.β206Updated last year
- Large Language Model (LLM) Inference API and Chatbotβ126Updated last year
- β199Updated last year
- Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDBβ121Updated last year
- Fun project: LLM powered RAG Discord Bot that works seamlessly on CPUβ32Updated last year
- experiments with inference on llamaβ104Updated last year
- β19Updated 11 months ago
- β124Updated 8 months ago