scaleapi / llm-engine
Scale LLM Engine public repository
☆784Updated this week
Related projects ⓘ
Alternatives and complementary repositories for llm-engine
- RayLLM - LLMs on Ray☆1,236Updated 5 months ago
- A tool for evaluating LLMs☆392Updated 6 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆677Updated 7 months ago
- A tiny library for coding with large language models.☆1,215Updated 4 months ago
- Customizable implementation of the self-instruct paper.☆1,025Updated 8 months ago
- ☆745Updated 10 months ago
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,206Updated this week
- A school for camelids☆1,208Updated last year
- Fine-tune mistral-7B on 3090s, a100s, h100s☆702Updated last year
- Create repos and commits with AI.☆288Updated last year
- This repo contains data and code for the paper "Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Da…☆483Updated 7 months ago
- Retrieval Augmented Generation (RAG) framework and context engine powered by Pinecone☆975Updated last week
- 🧠 Motorhead is a memory and information retrieval server for LLMs.☆856Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆1,647Updated this week
- ☆471Updated 3 months ago
- Guide for fine-tuning Llama/Mistral/CodeLlama models and more☆536Updated 2 months ago
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,530Updated 4 months ago
- Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types☆388Updated last month
- Build robust LLM applications with true composability 🔗☆416Updated 10 months ago
- ⛓️ build cognitive systems, pythonic☆326Updated this week
- Exact structure out of any language model completion.☆502Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆886Updated last month
- Prompt programming with FMs.☆440Updated 4 months ago
- This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…☆583Updated last year
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,816Updated 9 months ago
- LangSmith Client SDK Implementations☆421Updated this week
- Low latency JSON generation using LLMs ⚡️☆386Updated 8 months ago
- Domain Adapted Language Modeling Toolkit - E2E RAG☆312Updated 2 weeks ago
- ☆1,421Updated last year