Alternatives and similar repositories for llama.py

Users that are interested in llama.py are comparing it to the libraries listed below

• the-crypt-keeper / tiny_starcoder
  Python examples using the bigcode/tiny_starcoder_py 159M model to generate code
  ☆45Updated 2 years ago
• advanced-stack / py-llm-core
  A pythonic library providing light-weighted interface with LLMs
  ☆131Updated 8 months ago
• eryk-mazus / xoxo
  a tiny, exploitable chatbot that can use tools
  ☆32Updated 2 years ago
• mzbac / AutoGPTQ-API
  Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
  ☆90Updated 2 years ago
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆76Updated 2 years ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated 2 years ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated 2 years ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆112Updated last year
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆65Updated 2 years ago
• absadiki / pyllamacpp
  Python bindings for llama.cpp
  ☆68Updated last year
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆156Updated 2 years ago
• devbrones / llama-prompts
  A collection of prompts for Llama
  ☆102Updated 2 years ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated 2 years ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated last year
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• lucyknada / detective-needle-llm
  ☆12Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆68Updated last year
• balisujohn / localpilot
  codellama on CPU without Docker
  ☆25Updated 2 years ago
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆30Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated 2 years ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆161Updated 2 years ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆21Updated 2 years ago
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆113Updated 2 years ago
• dsdanielpark / co-coder
  Co-Coder is a Python package that streamlines error debugging from Open AI chat GPT and Google Bard by providing hints, example code, and…
  ☆46Updated 2 years ago
• m18coppola / llama.sh
  No-messing-around sh client for llama.cpp's server
  ☆30Updated last year
• winstxnhdw / Examplify
  An offline CPU-first low-resource chat application to perform RAG on your corpus of data. Powered by OpenChat and CTranslate2.
  ☆14Updated 8 months ago
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆28Updated 2 years ago
• skeskinen / llama-lite
  Embeddings focused small version of Llama NLP model
  ☆107Updated 2 years ago
• NoteDance / Note
  Machine learning library, Distributed training, Deep learning, Reinforcement learning, Models, TensorFlow, PyTorch
  ☆70Updated last week
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated last year