aishwaryaprabhat / BigBertha
BigBertha is an architecture design that demonstrates how automated LLMOps (Large Language Models Operations) can be achieved on any Kubernetes cluster using open source container-native technologies 🌟
☆27Updated last year
Alternatives and similar repositories for BigBertha:
Users that are interested in BigBertha are comparing it to the libraries listed below
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated last year
- JupyterLab extension to provide a Kubeflow specific left area for Notebooks deployment☆18Updated 4 years ago
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆37Updated 11 months ago
- Adding NeMo Guardrails to a LlamaIndex RAG pipeline☆36Updated last year
- Additional packages (components, document stores and the likes) to extend the capabilities of Haystack☆142Updated this week
- ☆19Updated 5 months ago
- ☆27Updated 7 months ago
- Self-host LLMs with vLLM and BentoML☆97Updated last week
- Benchmark study on LanceDB, an embedded vector DB, for full-text search and vector search☆23Updated last year
- Leverage your LangChain trace data for fine tuning☆41Updated 8 months ago
- ☆76Updated 9 months ago
- SCIPE is a powerful tool for evaluating and diagnosing LLM (Large Language Model) graphs or chains.☆21Updated 4 months ago
- ☆78Updated 10 months ago
- Build reliable, secure, and production-ready AI apps easily.☆70Updated this week
- Tuning the Finetuning: An exploration of achieving success with QLoRA☆43Updated 10 months ago
- ☆16Updated 10 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆129Updated 5 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆90Updated last month
- ☆32Updated 2 months ago
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated last year
- Dynamic Metadata based RAG Framework☆72Updated 8 months ago
- Handout for a talk I gave about LLM and CLI tools☆62Updated 9 months ago
- Repository for makeinga a GitHub Actions for deploying to Kubeflow.☆35Updated 3 years ago
- Research notes and extra resources for all the work at explodinggradients.com☆23Updated 3 weeks ago
- ☆20Updated 2 years ago
- 🧪 Experimental features for Haystack☆41Updated this week
- Repository for open inference protocol specification☆52Updated 8 months ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated last month
- ☆69Updated 9 months ago