ray-project / llm-numbers
Numbers every LLM developer should know
☆4,103Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for llm-numbers
- A language for constraint-guided and efficient LLM programming.☆3,699Updated 5 months ago
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,464Updated 8 months ago
- Python package for easily interfacing with chat apps, with robust features and minimal code complexity.☆3,491Updated 4 months ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,238Updated 2 months ago
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,455Updated 8 months ago
- Adding guardrails to large language models.☆4,127Updated this week
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆5,994Updated 2 months ago
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,571Updated last month
- A guidance language for controlling large language models.☆19,118Updated last week
- Large Language Model Text Generation Inference☆9,122Updated this week
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆3,699Updated last month
- Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.☆1,972Updated 2 months ago
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,384Updated last year
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆4,190Updated this week
- [NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models☆4,818Updated 4 months ago
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,579Updated 3 months ago
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆11,487Updated this week
- An awesome & curated list of best LLMOps tools for developers☆4,021Updated this week
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆3,271Updated 8 months ago
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,355Updated 3 weeks ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,653Updated this week
- ☆3,257Updated last year
- Simple UI for LLM Model Finetuning☆2,045Updated 10 months ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,269Updated 3 months ago
- LLM as a Chatbot Service☆3,296Updated last year
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,248Updated 2 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,059Updated 5 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,409Updated 3 months ago
- An LLM playground you can run on your laptop☆6,274Updated 3 weeks ago