Alternatives and similar repositories for llama-cpp-python-exploit

Users that are interested in llama-cpp-python-exploit are comparing it to the libraries listed below

• tangledgroup / llm-agent-smith
  llm-agent-smith
  ☆12Updated last year
• marella / ctransformers
  Python bindings for the Transformer models implemented in C/C++ using GGML library.
  ☆1,868Updated last year
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,228Updated last week
• mistralai / mistral-finetune
  ☆2,981Updated 10 months ago
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,887Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆714Updated last year
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,560Updated last month
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,471Updated last week
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,312Updated last year
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,262Updated 4 months ago
• PiotrNawrot / nanoT5
  Fast & Simple repository for pre-training and fine-tuning T5-style models
  ☆1,005Updated 10 months ago
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,992Updated last month
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,231Updated 4 months ago
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,631Updated last year
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,011Updated 3 months ago
• MeetKai / functionary
  Chat language model that can use tools and interpret the results
  ☆1,569Updated last month
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,260Updated this week
• pytorch / torchtune
  PyTorch native post-training library
  ☆5,323Updated this week
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆6,016Updated 3 weeks ago
• alasdairforsythe / tokenmonster
  Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
  ☆588Updated last year
• huggingface / optimum-nvidia
  ☆986Updated 5 months ago
• abertsch72 / unlimiformer
  Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"
  ☆1,062Updated last year
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,927Updated last year
• intel / intel-extension-for-transformers
  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…
  ☆2,167Updated 9 months ago
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,473Updated this week
• explosion / curated-transformers
  🤖 A PyTorch library of curated Transformer models and their composable components
  ☆892Updated last year
• HazyResearch / safari
  Convolutions for Sequence Modeling
  ☆891Updated last year
• carlini / yet-another-applied-llm-benchmark
  A benchmark to evaluate language models on questions I've previously asked them to solve.
  ☆1,022Updated 2 months ago
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,891Updated 3 months ago
• brevdev / launchables
  Collection of notebook guides created by the Brev.dev team!
  ☆1,774Updated 3 weeks ago