scaleapi / llm-engine
Scale LLM Engine public repository
☆789Updated this week
Alternatives and similar repositories for llm-engine:
Users that are interested in llm-engine are comparing it to the libraries listed below
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆640Updated last year
- ☆754Updated last year
- This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Da…☆484Updated 9 months ago
- RayLLM - LLMs on Ray☆1,247Updated 7 months ago
- A tiny library for coding with large language models.☆1,219Updated 6 months ago
- Evaluation tool for LLM QA chains☆1,066Updated last year
- Customizable implementation of the self-instruct paper.☆1,035Updated 10 months ago
- Prompt programming with FMs.☆440Updated 5 months ago
- LLM fine-tuning and eval☆342Updated 9 months ago
- Exact structure out of any language model completion.☆506Updated last year
- 🧠 Motorhead is a memory and information retrieval server for LLMs.☆864Updated last month
- A hyper-fast local vector database for use with LLM Agents. Now accepting SAFEs at $135M cap.☆1,384Updated 4 months ago
- ☆440Updated last year
- Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types☆393Updated 2 weeks ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆684Updated 9 months ago
- Fine-tune mistral-7B on 3090s, a100s, h100s☆704Updated last year
- Build robust LLM applications with true composability 🔗☆414Updated last year
- VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of y…☆682Updated 8 months ago
- Theory-of-mind powered AI tutor using o1 style reasoning☆768Updated this week
- Interactive Composition Explorer: a debugger for compositional language model programs☆539Updated last week
- ☆440Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆902Updated 2 months ago
- Guide for fine-tuning Llama/Mistral/CodeLlama models and more☆555Updated 4 months ago
- Custom AI assistant platform to speed up your work.☆1,012Updated this week
- Fine-Tuning Embedding for RAG with Synthetic Data☆477Updated last year
- A school for camelids☆1,210Updated last year
- ⛓️ build cognitive systems, pythonic☆328Updated last month
- ☆1,431Updated last year
- 🍰 PromptLayer - Maintain a log of your prompts and OpenAI API requests. Track, debug, and replay old completions.☆540Updated this week