aniketmaurya / fastserve-ai
Machine Learning Serving focused on GenAI with simplicity as the top priority.
☆58Updated 2 months ago
Alternatives and similar repositories for fastserve-ai:
Users that are interested in fastserve-ai are comparing it to the libraries listed below
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆46Updated 6 months ago
- Simple examples using Argilla tools to build AI☆53Updated 4 months ago
- ☆76Updated 9 months ago
- Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU☆32Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 8 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Updated last year
- ☆54Updated 2 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 3 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆64Updated 4 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆80Updated 9 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆67Updated 4 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆64Updated last week
- ☆75Updated last year
- Set of scripts to finetune LLMs☆37Updated 11 months ago
- tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.☆38Updated 6 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆46Updated last year
- Build Agentic workflows with function calling using open LLMs☆26Updated 2 weeks ago
- Solving data for LLMs - Create quality synthetic datasets!☆145Updated 2 months ago
- OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…☆29Updated last year
- 🤝 Trade any tensors over the network☆30Updated last year
- End-to-End LLM Guide☆104Updated 8 months ago
- Self-host LLMs with vLLM and BentoML☆94Updated this week
- ☆30Updated 8 months ago
- ☆99Updated 6 months ago
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆136Updated 7 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated 5 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Tools for merging pretrained large language models.☆19Updated 9 months ago
- A list of AI memory projects☆83Updated 2 months ago