ray-project / llm-numbersLinks
Numbers every LLM developer should know
☆4,258Updated last year
Alternatives and similar repositories for llm-numbers
Users that are interested in llm-numbers are comparing it to the libraries listed below
Sorting:
- The Official Python Client for Lamini's API☆2,542Updated 5 months ago
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆7,035Updated last year
- A language for constraint-guided and efficient LLM programming.☆4,046Updated 3 months ago
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,807Updated last year
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,734Updated 2 months ago
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,533Updated last month
- Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.☆2,141Updated 6 months ago
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,805Updated 9 months ago
- A library for helping developers craft prompts for Large Language Models☆2,706Updated 2 years ago
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,079Updated 2 months ago
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,479Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,496Updated last year
- Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-sour…☆2,658Updated 11 months ago
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆4,116Updated 2 months ago
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,746Updated last year
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆49Updated 2 years ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,930Updated last year
- LLM as a Chatbot Service☆3,335Updated last year
- AutoChain: Build lightweight, extensible, and testable LLM Agents☆1,861Updated last year
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,526Updated 2 years ago
- LLM(😽)☆1,688Updated 7 months ago
- Large Language Model Text Generation Inference☆10,491Updated this week
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,264Updated 6 months ago
- ☆4,089Updated last year
- [NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models☆5,545Updated 7 months ago
- Structured Outputs☆12,522Updated last week
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆4,214Updated 7 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,407Updated 6 months ago
- Simple UI for LLM Model Finetuning☆2,067Updated last year
- Database system for AI-powered apps☆2,683Updated last year