Alternatives and similar repositories for Llama-2-Open-Source-LLM-CPU-Inference:

Users that are interested in Llama-2-Open-Source-LLM-CPU-Inference are comparing it to the libraries listed below

• liltom-eth / llama2-webui
  Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend…
  ☆1,962Updated 11 months ago
• a16z-infra / llama2-chatbot
  LLaMA v2 Chatbot
  ☆1,403Updated last year
• CStanKonrad / long_llama
  LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transform…
  ☆1,450Updated last year
• rlancemartin / auto-evaluator
  Evaluation tool for LLM QA chains
  ☆1,070Updated last year
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆819Updated last year
• ctlllll / LLM-ToolMaker
  ☆1,028Updated last year
• jina-ai / langchain-serve
  ⚡ Langchain apps in production using Jina & FastAPI
  ☆1,618Updated last year
• gabrielchua / RAGxplorer
  Open-source tool to visualise your RAG 🔮
  ☆1,111Updated 2 months ago
• run-llama / llama-hub
  A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
  ☆3,470Updated last year
• neulab / prompt2model
  prompt2model - Generate Deployable Models from Natural Language Instructions
  ☆1,982Updated 2 months ago
• lamini-ai / lamini
  The Official Python Client for Lamini's API
  ☆2,524Updated this week
• langchain-ai / auto-evaluator
  ☆757Updated last year
• marella / ctransformers
  Python bindings for the Transformer models implemented in C/C++ using GGML library.
  ☆1,843Updated last year
• ray-project / llm-applications
  A comprehensive guide to building RAG-based LLM applications for production.
  ☆1,772Updated 7 months ago
• eyurtsev / kor
  LLM(😽)
  ☆1,660Updated last month
• run-llama / llama-lab
  ☆1,451Updated last year
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆689Updated 10 months ago
• teknium1 / GPTeacher
  A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer
  ☆1,626Updated last year
• microsoft / Llama-2-Onnx
  ☆1,024Updated last year
• ray-project / ray-llm
  RayLLM - LLMs on Ray
  ☆1,260Updated 9 months ago
• h2oai / h2o-wizardlm
  Open-Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning
  ☆300Updated 4 months ago
• jncraton / languagemodels
  Explore large language models in 512MB of RAM
  ☆1,184Updated this week
• Victorwz / LongMem
  Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".
  ☆784Updated 11 months ago
• deep-diver / LLM-As-Chatbot
  LLM as a Chatbot Service
  ☆3,305Updated last year
• viddexa / autollm
  Ship RAG based LLM web apps in seconds.
  ☆986Updated last year
• minimaxir / simpleaichat
  Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
  ☆3,502Updated 8 months ago
• s-JoL / Open-Llama
  The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.
  ☆42Updated last year
• msoedov / langcorn
  ⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops
  ☆916Updated 7 months ago
• NVIDIA / NeMo-Guardrails
  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
  ☆4,476Updated this week
• xlang-ai / instructor-embedding
  [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
  ☆1,918Updated last month