ray-project / llm-numbers
Numbers every LLM developer should know
☆4,214Updated last year
Alternatives and similar repositories for llm-numbers:
Users that are interested in llm-numbers are comparing it to the libraries listed below
- A language for constraint-guided and efficient LLM programming.☆3,917Updated 11 months ago
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.☆4,711Updated 4 months ago
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,709Updated last year
- Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.☆2,085Updated 2 months ago
- A guidance language for controlling large language models.☆20,105Updated this week
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,491Updated 6 months ago
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆6,872Updated 9 months ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,530Updated 7 months ago
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,480Updated last year
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,482Updated last year
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,052Updated 8 months ago
- Structured Text Generation☆11,497Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,048Updated last month
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆3,968Updated 2 weeks ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,411Updated 10 months ago
- Robust recipes to align language models with human and AI preferences☆5,157Updated this week
- SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability v…☆7,981Updated this week
- A library for helping developers craft prompts for Large Language Models☆2,662Updated 2 years ago
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,033Updated this week
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,474Updated 8 months ago
- LLM as a Chatbot Service☆3,317Updated last year
- [NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models☆5,281Updated 3 months ago
- Adding guardrails to large language models.☆4,877Updated last week
- [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings☆1,940Updated 3 months ago
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,600Updated 7 months ago
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,723Updated 9 months ago
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆4,696Updated this week
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,843Updated 8 months ago
- Aligning pretrained language models with instruction data generated by themselves.☆4,359Updated 2 years ago
- Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-sour…☆2,643Updated 7 months ago