scaleapi / llm-engine
Scale LLM Engine public repository
☆799Updated 3 weeks ago
Alternatives and similar repositories for llm-engine:
Users that are interested in llm-engine are comparing it to the libraries listed below
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,261Updated last month
- Evaluation tool for LLM QA chains☆1,075Updated last year
- LLM fine-tuning and eval☆346Updated last year
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆653Updated last year
- ⛓️ build cognitive systems, pythonic☆336Updated 5 months ago
- This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Da…☆488Updated last year
- ☆457Updated last year
- ☆1,472Updated last year
- A voice chat app☆1,114Updated 2 weeks ago
- Build robust LLM applications with true composability 🔗☆418Updated last year
- Exact structure out of any language model completion.☆508Updated last year
- 🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.☆582Updated this week
- 🧠 Motorhead is a memory and information retrieval server for LLMs.☆877Updated 3 weeks ago
- data cleaning and curation for unstructured text☆329Updated 9 months ago
- A tool for evaluating LLMs☆418Updated 11 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆697Updated last year
- Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types☆397Updated 2 months ago
- LLMFlows - Simple, Explicit and Transparent LLM Apps☆693Updated 2 months ago
- A tiny library for coding with large language models.☆1,230Updated 9 months ago
- ☆767Updated last year
- OpenAI-compatible Python client that can call any LLM☆371Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆711Updated last year
- Interactive Composition Explorer: a debugger for compositional language model programs☆549Updated 3 weeks ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆854Updated last year
- Visualization and debugging tool for LangChain workflows☆730Updated last year
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,673Updated 9 months ago
- AI tutor powered by Theory-of-Mind reasoning☆812Updated this week
- A school for camelids☆1,209Updated 2 years ago
- Guide for fine-tuning Llama/Mistral/CodeLlama models and more☆586Updated 2 weeks ago
- Customizable implementation of the self-instruct paper.☆1,043Updated last year